Jul 07 15:00:25 devstack cinder-volume[76013]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 15:00:25 devstack cinder-volume[76013]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 15:00:25 devstack cinder-volume[76013]: we strongly recommend against using it for new projects. Jul 07 15:00:25 devstack cinder-volume[76013]: If you are already using Eventlet, we recommend migrating to a different Jul 07 15:00:25 devstack cinder-volume[76013]: framework. For more detail see Jul 07 15:00:25 devstack cinder-volume[76013]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 15:00:25 devstack cinder-volume[76013]: import eventlet # noqa Jul 07 15:00:28 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 15:00:28 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 15:00:28 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 15:00:29 devstack cinder-volume[76013]: INFO dbcounter [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Registered counter for database cinder Jul 07 15:00:29 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:00:29 devstack cinder-volume[76013]: DEBUG dbcounter [-] [76013] Writer thread running {{(pid=76013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 15:00:29 devstack cinder-volume[76013]: INFO cinder.rpc [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 15:00:29 devstack cinder-volume[76013]: INFO cinder.rpc [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 15:00:29 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:00:29 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Determined volume DB was empty at startup. Jul 07 15:00:29 devstack cinder-volume[76013]: DEBUG cinder.volume.manager [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76013) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 15:00:29 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 15:00:29 devstack cinder-volume[76013]: WARNING stevedore.named [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 15:00:29 devstack cinder-volume[76013]: WARNING castellan.key_manager [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 15:00:29 devstack cinder-volume[76013]: WARNING cinder.keymgr.conf_key_mgr [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 15:00:29 devstack cinder-volume[76013]: DEBUG cinder.volume.drivers.lvm [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76013) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 15:00:29 devstack cinder-volume[76013]: DEBUG oslo_concurrency.processutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_concurrency.processutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.439s {{(pid=76013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:00:30 devstack cinder-volume[76013]: INFO cinder.rpc [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 15:00:30 devstack cinder-volume[76013]: INFO cinder.rpc [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 15:00:30 devstack cinder-volume[76013]: WARNING stevedore.named [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 15:00:30 devstack cinder-volume[76013]: WARNING castellan.key_manager [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 15:00:30 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:00:30 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Starting 1 workers Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Started child 76173 {{(pid=76013) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Full set of CONF: {{(pid=76013) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] ******************************************************************************** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Configuration options gathered from: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] ================================================================================ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] allow_availability_zone_fallback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] allow_compression_on_image_upload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] allowed_direct_url_schemes = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] api_rate_limit = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] auth_strategy = keystone {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] az_cache_duration = 3600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_host = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_stats_polling_interval = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76173]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backup_api_class = cinder.backup.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backup_name_template = backup-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backup_use_same_host = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backup_use_temp_snapshot = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] chap_username = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_internal_tenant_project_id = 95764f8f709b4cf8b5f78f832e5f1be4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_internal_tenant_user_id = b76cdb2205c44b5f856806eb80fb1f86 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cloned_volume_same_az = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cluster = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] compression_format = gzip {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] compute_api_class = cinder.compute.nova.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] config_dir = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] config_source = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] control_exchange = openstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] debug = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] default_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] default_group_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] default_volume_type = lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] driver_ssl_cert_verify = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] driver_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] enable_force_upload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] enable_new_services = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] enable_unsupported_driver = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] enforce_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_api_insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_api_ssl_compression = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_ca_certificates_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_catalog_info = image:glance:publicURL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_num_retries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance_request_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] graceful_shutdown_timeout = 5 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] group_api_class = cinder.group.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] host = devstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_compress_on_upload = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_conversion_address_space_limit = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_conversion_cpu_limit = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_conversion_disable = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_upload_use_cinder_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_upload_use_internal_tenant = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_volume_cache_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_volume_cache_max_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] image_volume_cache_max_size_gb = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] init_host_max_objects_retrieval = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] instance_format = [instance: %(uuid)s] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] iscsi_target_flags = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] iscsi_write_cache = on {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] iser_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] iser_ip_address = 192.168.122.71 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] iser_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_color = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_config_append = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_options = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_rotate_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_rotate_interval_type = days {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] log_rotation_type = none {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] max_age = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] max_logfile_count = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] max_logfile_size_mb = 200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] max_over_subscription_ratio = 20.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] message_reap_interval = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] message_ttl = 2592000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] migration_create_volume_timeout_secs = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] monkey_patch = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] monkey_patch_modules = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] my_ip = 192.168.122.71 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] no_snapshot_gb_quota = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] num_iser_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] num_shell_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] num_volume_device_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] nvmeof_conn_info_version = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] nvmet_ns_id = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] nvmet_port_id = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] osapi_max_limit = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] osapi_volume_ext_list = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] osapi_volume_listen_port = 8776 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] osapi_volume_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] osapi_volume_workers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] per_volume_size_limit = -1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] periodic_fuzzy_delay = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] periodic_interval = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] public_endpoint = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] publish_errors = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] quota_backup_gigabytes = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] quota_backups = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] quota_gigabytes = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] quota_groups = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] quota_snapshots = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] quota_volumes = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] rate_limit_burst = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] rate_limit_except_level = CRITICAL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] rate_limit_interval = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] reinit_driver_count = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] report_discard_supported = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] report_interval = 120 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] reservation_clean_interval = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] reservation_expire = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] reserved_image_namespaces = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] reserved_percentage = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] rpc_response_timeout = 120 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] run_external_periodic_tasks = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] scst_target_driver = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_down_time = 720 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] shell_completion = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] snapshot_name_template = snapshot-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] snapshot_same_host = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] state_path = /opt/stack/data/cinder {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] storage_availability_zone = nova {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] storage_protocol = iSCSI {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] syslog_log_facility = LOG_USER {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] target_helper = lioadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] target_ip_address = 192.168.122.71 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] target_secondary_ip_addresses = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] transport_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] until_refresh = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] use_chap_auth = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] use_default_quota_class = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] use_journal = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] use_json = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] use_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] use_stderr = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] use_syslog = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] verify_glance_signatures = enabled {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_api_class = cinder.volume.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_clear_size = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_copy_bps_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_dd_blocksize = 1M {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_name_template = volume-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_service_inithost_offload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volume_usage_audit_period = month {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] zoning_mode = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.auth_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.cache = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.include_service_catalog = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.interface = public {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_password = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcache_username = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.service_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.backend = dogpile.cache.null {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.backend_argument = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.backend_expiration_time = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.config_prefix = cache.oslo {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.debug_cache_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.enable_retry_client = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.enable_socket_keepalive = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.expiration_time = 600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.hashclient_retry_attempts = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.memcache_dead_retry = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.memcache_pool_maxsize = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.memcache_sasl_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.proxies = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.redis_db = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.redis_server = localhost:6379 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.retry_attempts = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.retry_delay = 0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.socket_keepalive_count = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.socket_keepalive_idle = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.socket_keepalive_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.socket_timeout = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.tls_allowed_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.tls_cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.tls_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.tls_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.tls_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cache.username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.asyncio_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.asyncio_slave_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.backend = sqlalchemy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.connection_debug = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.connection_parameters = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.connection_recycle_time = 3600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.connection_trace = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.db_inc_retry_interval = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.db_max_retries = 20 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.db_max_retry_interval = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.db_retry_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.max_overflow = 50 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.max_pool_size = 5 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.max_retries = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.mysql_wsrep_sync_wait = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.pool_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.retry_interval = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.slave_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.sqlite_synchronous = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.synchronous_reader = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] database.use_db_reconnect = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.connection_string = messaging:// {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.es_doc_type = notification {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.es_scroll_size = 10000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.es_scroll_time = 2m {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.filter_error_trace = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.hmac_keys = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.sentinel_service_name = mymaster {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.socket_timeout = 0.1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.trace_requests = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler.trace_sqlalchemy = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler_jaeger.process_tags = {} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] profiler_otlp.service_name_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.enforce_new_defaults = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.enforce_scope = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.policy_default_rule = default {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.policy_file = policy.yaml {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] coordination.backend_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] privsep_osbrick.group = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] privsep_osbrick.helper_command = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] privsep_osbrick.user = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_sys_admin.group = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_sys_admin.helper_command = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] cinder_sys_admin.user = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.send_service_user_token = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] service_user.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] glance.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:30 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.chap_username = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.driver_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.extra_capabilities = {} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.iscsi_target_flags = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.iscsi_write_cache = on {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.iser_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.iser_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.lvm_share_target = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.lvm_type = auto {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.num_shell_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.report_discard_supported = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.reserved_percentage = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:30 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.target_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.unique_fqdn_network = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.use_chap_auth = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_clear_size = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack sudo[76178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_reports.file_event_handler = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack sudo[76178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_reports.log_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.backend_host = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.chap_username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.extra_capabilities = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.iser_helper = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.iser_ip_address = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.iser_port = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.lvm_share_target = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.lvm_type = auto {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.num_shell_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.report_discard_supported = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.reserved_percentage = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.scst_target_driver = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.storage_protocol = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.target_helper = lioadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.target_ip_address = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.use_chap_auth = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_clear_size = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] lvmdriver-1.volumes_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_notifications.driver = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] key_manager.fixed_key = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.barbican_api_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.barbican_endpoint = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.barbican_endpoint_type = public {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.barbican_region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.number_of_retries = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.retry_delay = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.send_service_user_token = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.verify_ssl = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican.verify_ssl_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.auth_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] barbican_service_user.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.approle_role_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.approle_secret_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.kv_mountpoint = secret {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.kv_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.kv_version = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.root_token_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.ssl_ca_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:00:30 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] ******************************************************************************** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 15:00:31 devstack sudo[76178]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:31 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:31 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:31 devstack sudo[76241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:31 devstack sudo[76241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:32 devstack sudo[76241]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.680s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:00:32 devstack cinder-volume[76173]: INFO cinder.brick.local_dev.lvm [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:32 devstack sudo[76486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:00:32 devstack sudo[76486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:32 devstack sudo[76486]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG cinder.brick.local_dev.lvm [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76173) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 15:00:32 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:32 devstack sudo[76680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:32 devstack sudo[76680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:34 devstack sudo[76680]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.416s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:34 devstack sudo[76937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:34 devstack sudo[76937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:34 devstack sudo[76937]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:34 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:34 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 15:00:34 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:35 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:35 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.768s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:35 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:35 devstack sudo[76962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:00:35 devstack sudo[76962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:36 devstack sudo[76962]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:36 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.827s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:36 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:36 devstack sudo[76974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:00:36 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:37 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:37 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.839s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:37 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:37 devstack sudo[76978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:00:37 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:38 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:38 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:38 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:38 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:38 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:38 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:38 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:38 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:38 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:38 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:38 devstack sudo[76992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:38 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:39 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:39 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:39 devstack cinder-volume[76173]: INFO cinder.volume.drivers.lvm [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 15:00:39 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:39 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:39 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:39 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:39 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:40 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:40 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.840s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:40 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 15:00:40 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:40 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:00:40 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:40 devstack cinder-volume[76013]: DEBUG dbcounter [-] [76013] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:00:40 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:40 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:40 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:40 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:00:40 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:41 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:41 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:41 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:41 devstack sudo[77264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:41 devstack sudo[77264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:42 devstack sudo[77264]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:42 devstack sudo[77267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:00:42 devstack sudo[77267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:42 devstack sudo[77267]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:42 devstack cinder-volume[76173]: INFO cinder.volume.driver [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Driver hasn't implemented _init_vendor_properties() Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG cinder.volume.driver [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76173) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG oslo_db.sqlalchemy.engines [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writer thread running {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG cinder.db.sqlalchemy.api [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Building query based on filter {{(pid=76173) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG cinder.image.image_utils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76173) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 15:00:42 devstack cinder-volume[76173]: INFO cinder.keymgr.migration [None req-108de7fd-e7d3-46f3-b620-918c60025109 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 15:00:42 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:43 devstack sudo[77272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:00:43 devstack sudo[77272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:43 devstack sudo[77272]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:43 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:43 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:43 devstack sudo[77278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:00:43 devstack sudo[77278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:44 devstack sudo[77278]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:44 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:44 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:44 devstack sudo[77281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:44 devstack sudo[77281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:44 devstack sudo[77281]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:44 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:44 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:44 devstack sudo[77284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:00:44 devstack sudo[77284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:45 devstack sudo[77284]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:45 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:00:45 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Driver initialization completed successfully. Jul 07 15:00:45 devstack cinder-volume[76173]: INFO cinder.manager [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Initiating service 2 cleanup Jul 07 15:00:45 devstack cinder-volume[76173]: INFO cinder.manager [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Service 2 cleanup completed. Jul 07 15:00:45 devstack cinder-volume[76173]: DEBUG cinder.service [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Creating RPC server for service cinder-volume {{(pid=76173) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 15:00:45 devstack cinder-volume[76173]: DEBUG cinder.service [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76173) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 15:00:45 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 15:00:45 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 15:00:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:45 devstack sudo[77288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:00:45 devstack sudo[77288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:46 devstack sudo[77288]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:46 devstack sudo[77292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:00:46 devstack sudo[77292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:47 devstack sudo[77292]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:47 devstack sudo[77298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:00:47 devstack sudo[77298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:47 devstack sudo[77298]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:00:47 devstack sudo[77355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:00:47 devstack sudo[77355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:00:48 devstack sudo[77355]: pam_unix(sudo:session): session closed for user root Jul 07 15:00:48 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:00:48 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-c91fd67e-7ba3-46fa-9d58-879227d695ca None None] Driver post RPC initialization completed successfully. Jul 07 15:00:58 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=4 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:00:58 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:01:03 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:01:03 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:01:03 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread info: [<_MainThread(MainThread, started 137070698827904)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:02:03 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:02:03 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 15:02:03 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:02:03 devstack sudo[79670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:02:03 devstack sudo[79670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:02:04 devstack sudo[79670]: pam_unix(sudo:session): session closed for user root Jul 07 15:02:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:02:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:02:04 devstack sudo[79700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:02:04 devstack sudo[79700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:02:04 devstack sudo[79700]: pam_unix(sudo:session): session closed for user root Jul 07 15:02:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:02:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:02:04 devstack sudo[79704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:02:04 devstack sudo[79704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:02:05 devstack sudo[79704]: pam_unix(sudo:session): session closed for user root Jul 07 15:02:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:02:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:02:05 devstack sudo[79707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:02:05 devstack sudo[79707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:02:05 devstack sudo[79707]: pam_unix(sudo:session): session closed for user root Jul 07 15:02:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:02:05 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:02:05 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:02:05 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:02:05 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread info: [<_MainThread(MainThread, started 137070698827904)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:02:58 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=1 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:02:58 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:UPDATE=1 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:03:03 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:03:03 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 15:03:03 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:03:03 devstack sudo[82690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:03:03 devstack sudo[82690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:03:04 devstack sudo[82690]: pam_unix(sudo:session): session closed for user root Jul 07 15:03:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:03:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:03:04 devstack sudo[82693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:03:04 devstack sudo[82693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:03:04 devstack sudo[82693]: pam_unix(sudo:session): session closed for user root Jul 07 15:03:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:03:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:03:04 devstack sudo[82697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:03:04 devstack sudo[82697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:03:05 devstack sudo[82697]: pam_unix(sudo:session): session closed for user root Jul 07 15:03:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:03:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:03:05 devstack sudo[82700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:03:05 devstack sudo[82700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:03:06 devstack sudo[82700]: pam_unix(sudo:session): session closed for user root Jul 07 15:03:06 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:03:06 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:03:06 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:03:06 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:03:06 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread info: [<_MainThread(MainThread, started 137070698827904)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:04:03 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:04:03 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 15:04:03 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:04:03 devstack sudo[84918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:04:03 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:04:04 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root Jul 07 15:04:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:04:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:04:04 devstack sudo[84922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:04:04 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:04:04 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root Jul 07 15:04:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:04:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:04:04 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:04:04 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:04:05 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Jul 07 15:04:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:04:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:04:05 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:04:05 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:04:05 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Jul 07 15:04:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:04:05 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:04:05 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:04:05 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:04:05 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread info: [<_MainThread(MainThread, started 137070698827904)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:04:58 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=1 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:04:58 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:UPDATE=1 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:05:03 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:05:03 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 15:05:03 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:03 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 15:05:03 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:04 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:04 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:05:04 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:04 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:04 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:04 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 15:05:04 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:05 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:05 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 15:05:05 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:05 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:05 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:05 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:05:05 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:05:05 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:05:05 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-736e862f-d5d4-41d6-9f3d-2a717f347176 None None] thread info: [<_MainThread(MainThread, started 137070698827904)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:05:07 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Caught SIGTERM, stopping children Jul 07 15:05:07 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Acquiring lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 15:05:07 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Acquired lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 15:05:07 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Releasing lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 15:05:07 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Stop services. {{(pid=76013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 15:05:07 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Killing children. {{(pid=76013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 15:05:07 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Waiting on 1 children to exit Jul 07 15:05:10 devstack cinder-volume[76173]: DEBUG oslo_concurrency.lockutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Acquiring lock "singleton_lock" {{(pid=76173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 15:05:10 devstack cinder-volume[76173]: DEBUG oslo_concurrency.lockutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Acquired lock "singleton_lock" {{(pid=76173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 15:05:10 devstack cinder-volume[76173]: DEBUG oslo_concurrency.lockutils [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Releasing lock "singleton_lock" {{(pid=76173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 15:05:10 devstack cinder-volume[76173]: WARNING amqp [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 15:05:10 devstack cinder-volume[76173]: WARNING amqp [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 15:05:10 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-20ff3743-148e-4376-9d81-643f121253d6 None None] Child 76173 exited with status 0 Jul 07 15:05:11 devstack cinder-volume[86298]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 15:05:11 devstack cinder-volume[86298]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 15:05:11 devstack cinder-volume[86298]: we strongly recommend against using it for new projects. Jul 07 15:05:11 devstack cinder-volume[86298]: If you are already using Eventlet, we recommend migrating to a different Jul 07 15:05:11 devstack cinder-volume[86298]: framework. For more detail see Jul 07 15:05:11 devstack cinder-volume[86298]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 15:05:11 devstack cinder-volume[86298]: import eventlet # noqa Jul 07 15:05:13 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 15:05:13 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 15:05:13 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 15:05:13 devstack cinder-volume[86298]: INFO dbcounter [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Registered counter for database cinder Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_db.sqlalchemy.engines [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG dbcounter [-] [86298] Writer thread running {{(pid=86298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 15:05:14 devstack cinder-volume[86298]: INFO cinder.rpc [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 15:05:14 devstack cinder-volume[86298]: INFO cinder.rpc [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_db.sqlalchemy.engines [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:14 devstack cinder-volume[86298]: INFO cinder.volume.manager [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Determined volume DB was empty at startup. Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG cinder.volume.manager [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86298) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 15:05:14 devstack cinder-volume[86298]: INFO cinder.volume.manager [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 15:05:14 devstack cinder-volume[86298]: WARNING stevedore.named [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 15:05:14 devstack cinder-volume[86298]: WARNING castellan.key_manager [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 15:05:14 devstack cinder-volume[86298]: WARNING cinder.keymgr.conf_key_mgr [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 15:05:14 devstack cinder-volume[86298]: INFO cinder.volume.manager [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_db.sqlalchemy.engines [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:14 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Starting 1 workers Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Started child 86515 {{(pid=86298) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Full set of CONF: {{(pid=86298) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] ******************************************************************************** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Configuration options gathered from: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] ================================================================================ {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] allow_availability_zone_fallback = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] allow_compression_on_image_upload = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] allowed_direct_url_schemes = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] api_rate_limit = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] auth_strategy = keystone {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86515]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_host = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_stats_polling_interval = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backup_api_class = cinder.backup.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backup_name_template = backup-%s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backup_use_same_host = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backup_use_temp_snapshot = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] chap_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] chap_username = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_internal_tenant_project_id = 95764f8f709b4cf8b5f78f832e5f1be4 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_internal_tenant_user_id = b76cdb2205c44b5f856806eb80fb1f86 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cluster = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] compression_format = gzip {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] config_dir = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] config_source = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] control_exchange = openstack {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] debug = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] default_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] default_group_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] default_volume_type = QuobyteHD {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] disk_geometry = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] driver_client_cert = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] driver_client_cert_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] driver_data_namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] driver_ssl_cert_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] driver_ssl_cert_verify = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] driver_use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] enable_new_services = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] enable_unsupported_driver = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] enforce_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] filter_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_api_insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_api_ssl_compression = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_ca_certificates_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_num_retries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance_request_timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] goodness_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] graceful_shutdown_timeout = 5 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] group_api_class = cinder.group.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] host = devstack {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_compress_on_upload = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_conversion_address_space_limit = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_conversion_cpu_limit = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_conversion_disable = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_upload_use_cinder_backend = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_upload_use_internal_tenant = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_volume_cache_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_volume_cache_max_count = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] init_host_max_objects_retrieval = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] instance_format = [instance: %(uuid)s] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] iscsi_target_flags = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] iscsi_write_cache = on {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] iser_helper = tgtadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] iser_ip_address = 192.168.122.71 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] iser_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_color = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_config_append = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_dir = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_options = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_rotate_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_rotate_interval_type = days {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] log_rotation_type = none {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] max_age = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] max_logfile_count = 30 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] max_logfile_size_mb = 200 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] max_over_subscription_ratio = 20.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] message_reap_interval = 86400 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] message_ttl = 2592000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] monkey_patch = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] monkey_patch_modules = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] my_ip = 192.168.122.71 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] no_snapshot_gb_quota = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] num_iser_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] num_shell_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] num_volume_device_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] nvmeof_conn_info_version = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] nvmet_ns_id = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] nvmet_port_id = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] osapi_max_limit = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] osapi_volume_ext_list = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] osapi_volume_listen_port = 8776 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] osapi_volume_use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] osapi_volume_workers = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] per_volume_size_limit = -1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] periodic_fuzzy_delay = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] periodic_interval = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] public_endpoint = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] publish_errors = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] quota_backup_gigabytes = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] quota_backups = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] quota_gigabytes = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] quota_groups = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] quota_snapshots = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] quota_volumes = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] rate_limit_burst = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] rate_limit_except_level = CRITICAL {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] rate_limit_interval = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] reinit_driver_count = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] replication_device = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] report_discard_supported = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] report_interval = 120 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] reservation_clean_interval = 86400 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] reservation_expire = 86400 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] reserved_image_namespaces = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] reserved_percentage = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] rpc_response_timeout = 120 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] run_external_periodic_tasks = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] scst_target_driver = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] scst_target_iqn_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_down_time = 720 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] shell_completion = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] snapshot_name_template = snapshot-%s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] state_path = /opt/stack/data/cinder {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] storage_availability_zone = nova {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] storage_protocol = iSCSI {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] syslog_log_facility = LOG_USER {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] target_helper = lioadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] target_ip_address = 192.168.122.71 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] target_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] target_protocol = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] target_secondary_ip_addresses = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] trace_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] transport_url = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] until_refresh = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] use_chap_auth = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] use_default_quota_class = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] use_journal = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] use_json = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] use_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] use_stderr = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] use_syslog = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] verify_glance_signatures = enabled {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_api_class = cinder.volume.api.API {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_backend_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86515) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_clear = zero {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_clear_ionice = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_clear_size = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_copy_bps_limit = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_dd_blocksize = 1M {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_name_template = volume-%s {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_service_inithost_offload = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volume_usage_audit_period = month {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] zoning_mode = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.auth_type = password {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.auth_version = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.cache = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.interface = public {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_password = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcache_username = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.region_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.service_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.backend = dogpile.cache.null {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.backend_argument = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.backend_expiration_time = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.config_prefix = cache.oslo {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.debug_cache_backend = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.enable_retry_client = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.enable_socket_keepalive = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.expiration_time = 600 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.memcache_dead_retry = 300 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.memcache_sasl_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.proxies = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.redis_db = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.redis_server = localhost:6379 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.retry_attempts = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.retry_delay = 0.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.socket_keepalive_count = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.socket_keepalive_idle = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.socket_keepalive_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.socket_timeout = 1.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.tls_allowed_ciphers = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.tls_cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.tls_certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.tls_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.tls_keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cache.username = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.asyncio_connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.asyncio_slave_connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.backend = sqlalchemy {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.connection_debug = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.connection_parameters = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.connection_recycle_time = 3600 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.connection_trace = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.db_inc_retry_interval = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.db_max_retries = 20 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.db_max_retry_interval = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.db_retry_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.max_overflow = 50 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.max_pool_size = 5 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.max_retries = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.pool_timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.retry_interval = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.slave_connection = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.sqlite_synchronous = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.synchronous_reader = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] database.use_db_reconnect = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.connection_string = messaging:// {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.es_doc_type = notification {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.es_scroll_size = 10000 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.es_scroll_time = 2m {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.filter_error_trace = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.hmac_keys = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.sentinel_service_name = mymaster {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.socket_timeout = 0.1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.trace_requests = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler.trace_sqlalchemy = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler_jaeger.process_tags = {} {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] profiler_otlp.service_name_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.enforce_scope = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.policy_default_rule = default {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] coordination.backend_url = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] privsep_osbrick.group = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] privsep_osbrick.helper_command = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] privsep_osbrick.user = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_sys_admin.group = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_sys_admin.helper_command = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] cinder_sys_admin.user = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.auth_type = password {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.send_service_user_token = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] service_user.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.auth_type = password {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.region_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] glance.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.backend_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.chap_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.chap_username = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.disk_geometry = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.driver_client_cert = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.driver_data_namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.driver_use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.extra_capabilities = {} {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.filter_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.goodness_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.iscsi_target_flags = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.iser_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_host = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_login = admin {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_mount_options = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_private_key = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_share_path = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.replication_device = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.report_discard_supported = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.target_helper = tgtadm {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.target_port = 3260 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.target_protocol = iscsi {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.trace_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.use_chap_auth = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_backend_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_clear = zero {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_reports.file_event_handler = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_reports.log_dir = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86515) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 15:05:14 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 15:05:14 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.backend_host = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.chap_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.chap_username = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Running cmd (subprocess): mount.quobyte {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.disk_geometry = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.driver_client_cert = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.extra_capabilities = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.filter_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.goodness_function = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.iser_helper = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.iser_ip_address = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.iser_port = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_host = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_login = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_mount_options = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_password = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_private_key = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_share_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.num_shell_tries = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.replication_device = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.report_discard_supported = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.reserved_percentage = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.scst_target_driver = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.storage_protocol = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.target_helper = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.target_ip_address = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.target_port = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.target_prefix = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.target_protocol = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.trace_flags = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.use_chap_auth = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:14 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_clear = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_clear_size = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] QuobyteHD.volumes_dir = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_notifications.driver = [] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] key_manager.fixed_key = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.barbican_api_version = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.barbican_endpoint = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.barbican_endpoint_type = public {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.barbican_region_name = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.number_of_retries = 60 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.retry_delay = 1 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.send_service_user_token = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.verify_ssl = True {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican.verify_ssl_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.auth_section = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.auth_type = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.cafile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.certfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.collect_timing = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.insecure = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.keyfile = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.split_loggers = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] barbican_service_user.timeout = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.approle_role_id = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.approle_secret_id = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.kv_mountpoint = secret {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.kv_path = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.kv_version = 2 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.namespace = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.root_token_id = **** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.ssl_ca_crt_file = None {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.timeout = 60.0 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.use_ssl = False {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:15 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] ******************************************************************************** {{(pid=86298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 15:05:15 devstack quobyte-client[86520]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 15:05:15 devstack quobyte-client[86520]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:05:15 devstack cinder-volume[86515]: INFO cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf ... Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 -c /etc/quobyte/client-cinder.cfg {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:15 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 -c /etc/quobyte/client-cinder.cfg Jul 07 15:05:15 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:15 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.834s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:15 devstack cinder-volume[86515]: INFO cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf succeeded Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.848s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:05:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:15 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:05:15 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:16 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.697s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:16 devstack cinder-volume[86515]: INFO cinder.volume.driver [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Driver hasn't implemented _init_vendor_properties() Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG cinder.volume.driver [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86515) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writer thread running {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG cinder.db.sqlalchemy.api [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Building query based on filter {{(pid=86515) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86515) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 15:05:16 devstack cinder-volume[86515]: INFO cinder.keymgr.migration [None req-f90084b5-0eb5-48a3-849a-b4a952e27b7b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:05:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:16 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:05:16 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:17 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.719s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:05:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Driver initialization completed successfully. Jul 07 15:05:17 devstack cinder-volume[86515]: INFO cinder.manager [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Initiating service 3 cleanup Jul 07 15:05:17 devstack cinder-volume[86515]: INFO cinder.manager [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Service 3 cleanup completed. Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG cinder.service [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Creating RPC server for service cinder-volume {{(pid=86515) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG cinder.service [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86515) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 15:05:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:05:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:17 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:05:17 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:18 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.917s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f6b1edb0-fa6c-4900-8503-ff5f959e876e None None] Driver post RPC initialization completed successfully. Jul 07 15:05:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:05:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:05:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:05:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:05:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:05:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:22 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:05:22 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:23 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.676s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:23 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-0942b8e3-2dd0-4231-b9fd-1fde78b8aad8 None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:05:24 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Caught SIGTERM, stopping children Jul 07 15:05:24 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Acquiring lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 15:05:24 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Acquired lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 15:05:24 devstack cinder-volume[86298]: DEBUG oslo_concurrency.lockutils [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Releasing lock "singleton_lock" {{(pid=86298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 15:05:24 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Stop services. {{(pid=86298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 15:05:24 devstack cinder-volume[86298]: DEBUG oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Killing children. {{(pid=86298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 15:05:24 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Waiting on 1 children to exit Jul 07 15:05:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Acquiring lock "singleton_lock" {{(pid=86515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 15:05:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Acquired lock "singleton_lock" {{(pid=86515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 15:05:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Releasing lock "singleton_lock" {{(pid=86515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 15:05:25 devstack cinder-volume[86515]: WARNING amqp [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 15:05:25 devstack cinder-volume[86515]: WARNING amqp [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 15:05:25 devstack cinder-volume[86298]: INFO oslo_service.backend._eventlet.service [None req-1da80840-a1d8-4b4a-b9d5-8243154854b3 None None] Child 86515 exited with status 0 Jul 07 15:05:26 devstack cinder-volume[86968]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 15:05:26 devstack cinder-volume[86968]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 15:05:26 devstack cinder-volume[86968]: we strongly recommend against using it for new projects. Jul 07 15:05:26 devstack cinder-volume[86968]: If you are already using Eventlet, we recommend migrating to a different Jul 07 15:05:26 devstack cinder-volume[86968]: framework. For more detail see Jul 07 15:05:26 devstack cinder-volume[86968]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 15:05:26 devstack cinder-volume[86968]: import eventlet # noqa Jul 07 15:05:29 devstack cinder-volume[86968]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86968) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 15:05:29 devstack cinder-volume[86968]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86968) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 15:05:29 devstack cinder-volume[86968]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86968) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 15:05:30 devstack cinder-volume[86968]: INFO dbcounter [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Registered counter for database cinder Jul 07 15:05:30 devstack cinder-volume[86968]: DEBUG oslo_db.sqlalchemy.engines [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86968) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:30 devstack cinder-volume[86968]: DEBUG dbcounter [-] [86968] Writer thread running {{(pid=86968) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 15:05:30 devstack cinder-volume[86968]: INFO cinder.rpc [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 15:05:30 devstack cinder-volume[86968]: INFO cinder.rpc [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_db.sqlalchemy.engines [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86968) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:31 devstack cinder-volume[86968]: INFO cinder.volume.manager [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Determined volume DB was empty at startup. Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG cinder.volume.manager [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86968) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 15:05:31 devstack cinder-volume[86968]: WARNING stevedore.named [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 15:05:31 devstack cinder-volume[86968]: WARNING castellan.key_manager [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 15:05:31 devstack cinder-volume[86968]: WARNING cinder.keymgr.conf_key_mgr [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 15:05:31 devstack cinder-volume[86968]: INFO cinder.volume.manager [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_db.sqlalchemy.engines [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86968) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:31 devstack cinder-volume[86968]: INFO oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Starting 1 workers Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Started child 87257 {{(pid=86968) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Full set of CONF: {{(pid=86968) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] ******************************************************************************** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] Configuration options gathered from: {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] ================================================================================ {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] allow_availability_zone_fallback = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] allow_compression_on_image_upload = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] allowed_direct_url_schemes = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] api_rate_limit = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] auth_strategy = keystone {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[87257]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_availability_zone = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_host = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_stats_polling_interval = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backup_api_class = cinder.backup.api.API {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backup_name_template = backup-%s {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backup_use_same_host = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backup_use_temp_snapshot = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] chap_password = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] chap_username = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_internal_tenant_project_id = 95764f8f709b4cf8b5f78f832e5f1be4 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_internal_tenant_user_id = b76cdb2205c44b5f856806eb80fb1f86 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cluster = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] compression_format = gzip {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] compute_api_class = cinder.compute.nova.API {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] config_dir = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] config_source = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] control_exchange = openstack {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] debug = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] default_availability_zone = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] default_group_type = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] default_volume_type = QuobyteHD {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] disk_geometry = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] driver_client_cert = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] driver_client_cert_key = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] driver_data_namespace = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] driver_ssl_cert_path = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] driver_ssl_cert_verify = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] driver_use_ssl = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] enable_new_services = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] enable_unsupported_driver = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] enabled_backends = ['QuobyteHD'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] enforce_multipath_for_image_xfer = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] filter_function = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_api_insecure = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_api_ssl_compression = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_ca_certificates_file = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_catalog_info = image:glance:publicURL {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_num_retries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance_request_timeout = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] goodness_function = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] graceful_shutdown_timeout = 5 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] group_api_class = cinder.group.api.API {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] host = devstack {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_compress_on_upload = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_conversion_address_space_limit = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_conversion_cpu_limit = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_conversion_disable = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_upload_use_cinder_backend = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_upload_use_internal_tenant = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_volume_cache_enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_volume_cache_max_count = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] image_volume_cache_max_size_gb = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] init_host_max_objects_retrieval = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] instance_format = [instance: %(uuid)s] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] iscsi_target_flags = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] iscsi_write_cache = on {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] iser_helper = tgtadm {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] iser_ip_address = 192.168.122.71 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] iser_port = 3260 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_color = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_config_append = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_dir = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_file = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_options = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_rotate_interval = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_rotate_interval_type = days {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] log_rotation_type = none {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87257) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] max_age = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] max_logfile_count = 30 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] max_logfile_size_mb = 200 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] max_over_subscription_ratio = 20.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] message_reap_interval = 86400 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] message_ttl = 2592000 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] migration_create_volume_timeout_secs = 300 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] monkey_patch = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] monkey_patch_modules = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] my_ip = 192.168.122.71 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] no_snapshot_gb_quota = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] num_iser_scan_tries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] num_shell_tries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] num_volume_device_scan_tries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] nvmeof_conn_info_version = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] nvmet_ns_id = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] nvmet_port_id = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] osapi_max_limit = 1000 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] osapi_volume_ext_list = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] osapi_volume_listen_port = 8776 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] osapi_volume_use_ssl = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] osapi_volume_workers = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] per_volume_size_limit = -1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] periodic_fuzzy_delay = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] periodic_interval = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] public_endpoint = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] publish_errors = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] quota_backup_gigabytes = 1000 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] quota_backups = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] quota_gigabytes = 1000 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] quota_groups = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] quota_snapshots = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] quota_volumes = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] rate_limit_burst = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] rate_limit_except_level = CRITICAL {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] rate_limit_interval = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] reinit_driver_count = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] replication_device = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] report_discard_supported = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] report_interval = 120 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] reservation_clean_interval = 86400 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] reservation_expire = 86400 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] reserved_image_namespaces = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] reserved_percentage = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] rpc_response_timeout = 120 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] run_external_periodic_tasks = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] scst_target_driver = iscsi {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] scst_target_iqn_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_down_time = 720 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] shell_completion = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] snapshot_name_template = snapshot-%s {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] split_loggers = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] state_path = /opt/stack/data/cinder {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] storage_availability_zone = nova {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] storage_protocol = iSCSI {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] syslog_log_facility = LOG_USER {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] target_helper = lioadm {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] target_ip_address = 192.168.122.71 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] target_port = 3260 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] target_protocol = iscsi {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] target_secondary_ip_addresses = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] trace_flags = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] transport_url = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] until_refresh = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] use_chap_auth = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] use_default_quota_class = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] use_journal = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] use_json = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] use_multipath_for_image_xfer = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] use_stderr = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] use_syslog = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] verify_glance_signatures = enabled {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_api_class = cinder.volume.api.API {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_backend_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_clear = zero {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_clear_ionice = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_clear_size = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_copy_bps_limit = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_dd_blocksize = 1M {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_name_template = volume-%s {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_service_inithost_offload = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volume_usage_audit_period = month {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] zoning_mode = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_concurrency.disable_process_locking = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.auth_section = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.auth_type = password {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.auth_version = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.cache = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.include_service_catalog = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.insecure = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.interface = public {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_password = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcache_username = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.region_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.service_type = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.backend = dogpile.cache.null {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.backend_argument = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.backend_expiration_time = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.config_prefix = cache.oslo {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.debug_cache_backend = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.enable_retry_client = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.enable_socket_keepalive = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.expiration_time = 600 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.hashclient_retry_attempts = 2 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87257) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.memcache_dead_retry = 300 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.memcache_pool_maxsize = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.memcache_sasl_enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.password = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.proxies = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Running cmd (subprocess): mount.quobyte {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.redis_db = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.redis_server = localhost:6379 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.retry_attempts = 2 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.retry_delay = 0.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.socket_keepalive_count = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.socket_keepalive_idle = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.socket_keepalive_interval = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.socket_timeout = 1.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.tls_allowed_ciphers = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.tls_cafile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.tls_certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.tls_enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.tls_keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cache.username = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.asyncio_connection = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.asyncio_slave_connection = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.backend = sqlalchemy {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.connection = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.connection_debug = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.connection_parameters = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.connection_recycle_time = 3600 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.connection_trace = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.db_inc_retry_interval = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.db_max_retries = 20 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.db_max_retry_interval = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.db_retry_interval = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.max_overflow = 50 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.max_pool_size = 5 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.max_retries = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.mysql_wsrep_sync_wait = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.pool_timeout = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.retry_interval = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.slave_connection = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.sqlite_synchronous = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.synchronous_reader = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] database.use_db_reconnect = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.connection_string = messaging:// {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.es_doc_type = notification {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.es_scroll_size = 10000 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.es_scroll_time = 2m {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.filter_error_trace = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.hmac_keys = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.sentinel_service_name = mymaster {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.socket_timeout = 0.1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.trace_requests = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler.trace_sqlalchemy = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler_jaeger.process_tags = {} {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler_jaeger.service_name_prefix = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] profiler_otlp.service_name_prefix = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.enforce_new_defaults = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.enforce_scope = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.policy_default_rule = default {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.policy_file = policy.yaml {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] coordination.backend_url = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] privsep_osbrick.group = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] privsep_osbrick.helper_command = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] privsep_osbrick.user = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_sys_admin.group = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_sys_admin.helper_command = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] cinder_sys_admin.user = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.auth_section = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.auth_type = password {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.cafile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.collect_timing = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.insecure = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.send_service_user_token = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.split_loggers = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] service_user.timeout = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.auth_section = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.auth_type = password {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.collect_timing = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.insecure = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.region_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.split_loggers = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] glance.timeout = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.backend_availability_zone = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.chap_password = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.chap_username = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.disk_geometry = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.driver_client_cert = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.driver_client_cert_key = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.driver_data_namespace = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.driver_use_ssl = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.extra_capabilities = {} {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.filter_function = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.goodness_function = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.iscsi_target_flags = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.iscsi_write_cache = on {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.iser_helper = tgtadm {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.iser_port = 3260 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_host = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_login = admin {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_mount_options = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_password = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_private_key = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_share_path = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.num_shell_tries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.quobyte_volume_url = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.replication_device = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.report_discard_supported = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.reserved_percentage = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.target_helper = tgtadm {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.target_port = 3260 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.target_protocol = iscsi {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.trace_flags = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.unique_fqdn_network = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.use_chap_auth = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_backend_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_clear = zero {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_clear_ionice = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_clear_size = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_reports.file_event_handler = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_reports.log_dir = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.backend_availability_zone = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.backend_host = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.chap_password = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.chap_username = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.chiscsi_conf = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.disk_geometry = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.driver_client_cert = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.driver_data_namespace = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.driver_use_ssl = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.extra_capabilities = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.filter_function = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.goodness_function = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.iser_helper = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.iser_ip_address = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.iser_port = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.iser_target_prefix = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_host = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_login = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_mount_options = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_password = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_private_key = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_share_path = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_ssh_port = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.num_shell_tries = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.nvmet_port_id = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.replication_device = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.report_discard_supported = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.reserved_percentage = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.scst_target_driver = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.storage_protocol = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:05:31 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.target_helper = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.target_ip_address = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.target_port = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.target_prefix = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.target_protocol = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.trace_flags = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.use_chap_auth = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_clear = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_clear_size = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] QuobyteHD.volumes_dir = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.ssl = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_notifications.driver = [] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_notifications.retry = -1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] key_manager.fixed_key = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.barbican_api_version = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.barbican_endpoint = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.barbican_endpoint_type = public {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.barbican_region_name = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.cafile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.collect_timing = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.insecure = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.number_of_retries = 60 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.retry_delay = 1 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.send_service_user_token = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.split_loggers = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.timeout = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.verify_ssl = True {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican.verify_ssl_path = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.auth_section = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.auth_type = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.cafile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.certfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.collect_timing = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.insecure = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.keyfile = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.split_loggers = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] barbican_service_user.timeout = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.approle_role_id = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.approle_secret_id = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.kv_mountpoint = secret {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.kv_path = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.kv_version = 2 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.namespace = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.root_token_id = **** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.ssl_ca_crt_file = None {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.timeout = 60.0 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.use_ssl = False {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 15:05:31 devstack cinder-volume[86968]: DEBUG oslo_service.backend._eventlet.service [None req-30dbd69b-0b82-40a6-bac4-6e60c1424064 None None] ******************************************************************************** {{(pid=86968) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 15:05:32 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.710s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:32 devstack cinder-volume[87257]: INFO cinder.volume.driver [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG cinder.volume.driver [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87257) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG oslo_db.sqlalchemy.engines [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87257) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writer thread running {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG cinder.db.sqlalchemy.api [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Building query based on filter {{(pid=87257) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87257) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:05:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:32 devstack cinder-volume[87257]: INFO cinder.keymgr.migration [None req-e5038710-a96f-44a1-878e-38423d9b1c1c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 15:05:32 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:05:32 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:33 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.644s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:05:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Driver initialization completed successfully. Jul 07 15:05:33 devstack cinder-volume[87257]: INFO cinder.manager [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Initiating service 3 cleanup Jul 07 15:05:33 devstack cinder-volume[87257]: INFO cinder.manager [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Service 3 cleanup completed. Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG cinder.service [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Creating RPC server for service cinder-volume {{(pid=87257) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG cinder.service [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87257) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 15:05:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:05:33 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:05:33 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:05:33 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Jul 07 15:05:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.635s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:05:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-104abba5-18fe-4704-af6e-4a78ec6914a6 None None] Driver post RPC initialization completed successfully. Jul 07 15:05:41 devstack cinder-volume[86968]: DEBUG dbcounter [-] [86968] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86968) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:05:43 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:05:43 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:05:59 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:05:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 6 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:05:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Flow 'volume_create_manager' (5ecb020f-4ee0-44e3-a25f-98c78ac0b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24befaa9-d8a7-4b20-b032-297ffcfc98a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24befaa9-d8a7-4b20-b032-297ffcfc98a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1831546135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f17b172-5508-49e1-8de8-112807581e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f337c4d70bf6433db2bbdd4838b0e00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:06:58Z,use_quota=True,user_id='6ae510a8210148f189098f28a2f9083f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349ab13e-2ed6-4dbf-b7eb-b00f1134f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349ab13e-2ed6-4dbf-b7eb-b00f1134f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce054ddc-9b70-4956-abb1-e6cdba3a02f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce054ddc-9b70-4956-abb1-e6cdba3a02f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f17b172-5508-49e1-8de8-112807581e53', 'volume_name': 'volume-1f17b172-5508-49e1-8de8-112807581e53', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6ed9ef-09bf-4d2d-82e7-ece52d36929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6ed9ef-09bf-4d2d-82e7-ece52d36929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a9e8f-c118-4dd7-b094-c0a52a164277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:06:58 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Volume 1f17b172-5508-49e1-8de8-112807581e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f17b172-5508-49e1-8de8-112807581e53', 'volume_size': 1} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1831546135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f17b172-5508-49e1-8de8-112807581e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f337c4d70bf6433db2bbdd4838b0e00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:06:58Z,use_quota=True,user_id='6ae510a8210148f189098f28a2f9083f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Creating volume 1f17b172-5508-49e1-8de8-112807581e53 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:06:58 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:06:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:06:58 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 1073741824 Jul 07 15:06:58 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:06:59 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:06:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:06:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:06:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:00 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:07:00 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:00 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 1073741824" returned: 0 in 1.187s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:00 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 Jul 07 15:07:00 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:00 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.875s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 6 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:07:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:07:01 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53" returned: 0 in 1.028s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:07:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a9e8f-c118-4dd7-b094-c0a52a164277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f17b172-5508-49e1-8de8-112807581e53', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4122d972-e800-4141-a284-0b30195bab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:01 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Volume volume-1f17b172-5508-49e1-8de8-112807581e53 (1f17b172-5508-49e1-8de8-112807581e53): created successfully Jul 07 15:07:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4122d972-e800-4141-a284-0b30195bab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Flow 'volume_create_manager' (5ecb020f-4ee0-44e3-a25f-98c78ac0b490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:07:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b76977f4-d77a-435b-ad6b-c15e4808ddfb tempest-VolumesAdminNegativeTest-574010714 None] Created volume successfully. Jul 07 15:07:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Acquiring lock "cinder-1f17b172-5508-49e1-8de8-112807581e53-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:07:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Lock "cinder-1f17b172-5508-49e1-8de8-112807581e53-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:07:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Acquiring lock "cinder-quobyte-1f17b172-5508-49e1-8de8-112807581e53" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:07:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Lock "cinder-quobyte-1f17b172-5508-49e1-8de8-112807581e53" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:07:02 devstack cinder-volume[87257]: INFO oslo.privsep.daemon [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjxjhttsx/privsep.sock'] Jul 07 15:07:02 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjxjhttsx/privsep.sock Jul 07 15:07:02 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 15:07:02 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 15:07:03 devstack cinder-volume[87257]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 15:07:04 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:04 devstack cinder-volume[87257]: INFO oslo.privsep.daemon [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Spawned new privsep daemon via rootwrap Jul 07 15:07:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Accepted privsep connection to /tmp/tmpjxjhttsx/privsep.sock {{(pid=87257) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 15:07:04 devstack cinder-volume[87257]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 15:07:04 devstack cinder-volume[87257]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 15:07:04 devstack cinder-volume[87257]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 15:07:04 devstack cinder-volume[87257]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88290 Jul 07 15:07:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f76401-f737-44a4-ab1e-4a021ba2efc8]: (2,) {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:07:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1725aef1-d89c-44c2-8ca3-14cf61065999]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:07:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:04 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 Jul 07 15:07:04 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:05 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53" returned: 0 in 0.961s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:05 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53 Jul 07 15:07:05 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:06 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1f17b172-5508-49e1-8de8-112807581e53" returned: 0 in 0.942s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Lock "cinder-quobyte-1f17b172-5508-49e1-8de8-112807581e53" released by "delete_volume" :: held 3.712s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:07:06 devstack cinder-volume[87257]: WARNING cinder.quota [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:07:06 devstack cinder-volume[87257]: WARNING cinder.quota [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Created reservations ['b3ecb83b-ff07-4ecb-a1bd-45ddc0229342', '6481674c-3269-4268-a00c-f7f045aa1aeb', 'bafb75bb-a5c5-4b2b-b3fe-01cd456c3c8a', '6e3610c5-4319-47ef-a87d-4409d774e5b2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:06 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:07:06 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:07 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.257s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:07 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:07:07 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Deleted volume successfully. Jul 07 15:07:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d3801b87-46d2-44c0-9a1e-a235f5b79c30 tempest-VolumesAdminNegativeTest-574010714 None] Lock "cinder-1f17b172-5508-49e1-8de8-112807581e53-delete_volume" released by "delete_volume" :: held 5.524s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Flow 'volume_create_manager' (562a27b0-36d2-496b-9f9d-bac0c3f519d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522225b9-abc3-44bb-8fb0-823eaef6c57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522225b9-abc3-44bb-8fb0-823eaef6c57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-217691845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f38b05-e433-4fe7-b0d7-e08f06e477e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31488534d3de4167973c4288bffc4bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:07:09Z,use_quota=True,user_id='8786f7fdf6974a65a6f7a46d516aab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f366420e-f7a1-419c-a34c-77fa92ad96d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f366420e-f7a1-419c-a34c-77fa92ad96d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda50b18-6462-426c-a197-0e97848b85c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda50b18-6462-426c-a197-0e97848b85c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f38b05-e433-4fe7-b0d7-e08f06e477e3', 'volume_name': 'volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e0858a-2902-4ed3-a80d-a48765a806c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e0858a-2902-4ed3-a80d-a48765a806c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b96857-ca38-499b-9c30-c64582ea4f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:09 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Volume c7f38b05-e433-4fe7-b0d7-e08f06e477e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3', 'volume_size': 1} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-217691845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f38b05-e433-4fe7-b0d7-e08f06e477e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31488534d3de4167973c4288bffc4bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:07:09Z,use_quota=True,user_id='8786f7fdf6974a65a6f7a46d516aab6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Creating volume c7f38b05-e433-4fe7-b0d7-e08f06e477e3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:07:09 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:07:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:09 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 1073741824 Jul 07 15:07:09 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:10 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 1073741824" returned: 0 in 1.200s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:10 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 Jul 07 15:07:10 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Flow 'volume_create_manager' (38b0fffc-2d77-40fa-ab99-93b15fb1c3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7e0999-6dca-456a-9bf0-8d6c1344e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7e0999-6dca-456a-9bf0-8d6c1344e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1916059156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa53bb7-d21a-407b-9bb0-f61033cdaba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae4a17621ba4720b5c7dac5f1c49537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:07:11Z,use_quota=True,user_id='cc1dea59e5e64ca08df0f7dfdd9a94d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5457f2e-639c-4ec1-a826-440480170ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5457f2e-639c-4ec1-a826-440480170ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7925d3c9-5929-4222-8df9-f07f20087ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7925d3c9-5929-4222-8df9-f07f20087ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa53bb7-d21a-407b-9bb0-f61033cdaba9', 'volume_name': 'volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabac9fc-778e-40bd-86b6-9453ed2875f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabac9fc-778e-40bd-86b6-9453ed2875f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f3039a-960d-45c2-9291-644f42c26f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:11 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Volume 8fa53bb7-d21a-407b-9bb0-f61033cdaba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9', 'volume_size': 1} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:11 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" returned: 0 in 0.983s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1916059156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa53bb7-d21a-407b-9bb0-f61033cdaba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae4a17621ba4720b5c7dac5f1c49537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:07:11Z,use_quota=True,user_id='cc1dea59e5e64ca08df0f7dfdd9a94d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Creating volume 8fa53bb7-d21a-407b-9bb0-f61033cdaba9 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:07:11 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:11 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 1073741824 Jul 07 15:07:11 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b96857-ca38-499b-9c30-c64582ea4f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6aeda-6a86-47e7-b8bf-cbac0db562d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:11 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Volume volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 (c7f38b05-e433-4fe7-b0d7-e08f06e477e3): created successfully Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f6aeda-6a86-47e7-b8bf-cbac0db562d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Flow 'volume_create_manager' (562a27b0-36d2-496b-9f9d-bac0c3f519d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:07:11 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3d0db545-532e-4ef0-b6e5-b034f1e833c4 tempest-ServerActionsTestOtherA-1219829658 None] Created volume successfully. Jul 07 15:07:12 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 1073741824" returned: 0 in 1.030s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:12 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 Jul 07 15:07:12 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:13 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9" returned: 0 in 0.946s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:07:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f3039a-960d-45c2-9291-644f42c26f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f992dab-736d-4b4e-8d9d-1ac2ee91c7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:13 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Volume volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 (8fa53bb7-d21a-407b-9bb0-f61033cdaba9): created successfully Jul 07 15:07:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f992dab-736d-4b4e-8d9d-1ac2ee91c7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Flow 'volume_create_manager' (38b0fffc-2d77-40fa-ab99-93b15fb1c3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:07:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-21c052f3-b9a8-40a3-a4b4-28478334af4a tempest-AttachVolumeShelveTestJSON-1724477556 None] Created volume successfully. Jul 07 15:07:23 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=18 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:07:23 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:07:32 devstack cinder-volume[87257]: WARNING py.warnings [req-33036a10-462e-4219-b260-9e2964879646 req-d3004b70-a812-4700-89b0-0adb15035ed9 tempest-AttachVolumeShelveTestJSON-1724477556 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 07 15:07:32 devstack cinder-volume[87257]: .first() Jul 07 15:07:32 devstack cinder-volume[87257]: Jul 07 15:07:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-33036a10-462e-4219-b260-9e2964879646 req-d3004b70-a812-4700-89b0-0adb15035ed9 tempest-AttachVolumeShelveTestJSON-1724477556 None] No connector for attachment 93a07cd5-753d-450d-829e-5235fd1fc0eb; skipping storage backend terminate_connection call. {{(pid=87257) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 15:07:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-33036a10-462e-4219-b260-9e2964879646 req-d3004b70-a812-4700-89b0-0adb15035ed9 tempest-AttachVolumeShelveTestJSON-1724477556 None] Deleting attachment 93a07cd5-753d-450d-829e-5235fd1fc0eb. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Flow 'volume_create_manager' (e337a97f-0896-4682-84fa-507360af1049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884dcbfa-ce1a-4dfc-a86f-bbbe91a81812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884dcbfa-ce1a-4dfc-a86f-bbbe91a81812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2006042476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1987ff9-4eca-467a-a6c4-f6c24faee164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d3dc34dde34a209ea70ba668a7da1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:07:37Z,use_quota=True,user_id='d2f6fa6fdbf7471fa78a2670cf1b9531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b69b29e-f6b0-46f5-bab2-749e740236fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b69b29e-f6b0-46f5-bab2-749e740236fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aded193a-0b06-4424-b471-03740c75209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aded193a-0b06-4424-b471-03740c75209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1987ff9-4eca-467a-a6c4-f6c24faee164', 'volume_name': 'volume-b1987ff9-4eca-467a-a6c4-f6c24faee164', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e606f4f-4001-4e01-ae7c-bfe0ce94edc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e606f4f-4001-4e01-ae7c-bfe0ce94edc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e64be6-8d43-4cea-ad6a-39729a23f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:36 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Volume b1987ff9-4eca-467a-a6c4-f6c24faee164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1987ff9-4eca-467a-a6c4-f6c24faee164', 'volume_size': 1} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2006042476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1987ff9-4eca-467a-a6c4-f6c24faee164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d3dc34dde34a209ea70ba668a7da1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:07:37Z,use_quota=True,user_id='d2f6fa6fdbf7471fa78a2670cf1b9531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Creating volume b1987ff9-4eca-467a-a6c4-f6c24faee164 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:07:36 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:07:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:37 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 1073741824 Jul 07 15:07:37 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:38 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 1073741824" returned: 0 in 1.540s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:38 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 Jul 07 15:07:38 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:39 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164" returned: 0 in 1.355s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] <== create_volume: return (2964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:07:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.968s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e64be6-8d43-4cea-ad6a-39729a23f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1987ff9-4eca-467a-a6c4-f6c24faee164', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23d891d-82db-462b-81bb-1fff34565682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:07:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Volume volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 (b1987ff9-4eca-467a-a6c4-f6c24faee164): created successfully Jul 07 15:07:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23d891d-82db-462b-81bb-1fff34565682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:07:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Flow 'volume_create_manager' (e337a97f-0896-4682-84fa-507360af1049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:07:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e3ea7577-a681-4eb5-993a-f02886d9ef09 tempest-DeleteServersTestJSON-1056998798 None] Created volume successfully. Jul 07 15:07:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-6665e1c4-9f63-4f6a-87ee-1d7b53f5d4d7 req-b9e78fca-c0ef-4e92-bfba-a87a8ebcf4d8 tempest-DeleteServersTestJSON-1056998798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-6665e1c4-9f63-4f6a-87ee-1d7b53f5d4d7 req-b9e78fca-c0ef-4e92-bfba-a87a8ebcf4d8 tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:07:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0f1d9c-5c4f-4493-93ac-6c6fe22179b9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:07:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-6665e1c4-9f63-4f6a-87ee-1d7b53f5d4d7 req-b9e78fca-c0ef-4e92-bfba-a87a8ebcf4d8 tempest-DeleteServersTestJSON-1056998798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:07:47 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 Jul 07 15:07:47 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:07:48 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Jul 07 15:07:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-6665e1c4-9f63-4f6a-87ee-1d7b53f5d4d7 req-b9e78fca-c0ef-4e92-bfba-a87a8ebcf4d8 tempest-DeleteServersTestJSON-1056998798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164" returned: 0 in 1.007s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:07:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-6665e1c4-9f63-4f6a-87ee-1d7b53f5d4d7 req-b9e78fca-c0ef-4e92-bfba-a87a8ebcf4d8 tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.039s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:07:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-6665e1c4-9f63-4f6a-87ee-1d7b53f5d4d7 req-b9e78fca-c0ef-4e92-bfba-a87a8ebcf4d8 tempest-DeleteServersTestJSON-1056998798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-b1987ff9-4eca-467a-a6c4-f6c24faee164', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82ff6e4a-2ae3-4ca9-8ae5-71e49e451843', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:07:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-6665e1c4-9f63-4f6a-87ee-1d7b53f5d4d7 req-b9e78fca-c0ef-4e92-bfba-a87a8ebcf4d8 tempest-DeleteServersTestJSON-1056998798 None] attachment_update completed successfully. Jul 07 15:07:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-07849778-c427-4763-a3cd-1961899c48fb req-94172902-e013-4b72-9682-f7ade40ee8ec tempest-DeleteServersTestJSON-1056998798 None] Terminate volume connection completed successfully. Jul 07 15:07:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-07849778-c427-4763-a3cd-1961899c48fb req-94172902-e013-4b72-9682-f7ade40ee8ec tempest-DeleteServersTestJSON-1056998798 None] Deleting attachment 82ff6e4a-2ae3-4ca9-8ae5-71e49e451843. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:07:59 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:07:59 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:07:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:07:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:08:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:08:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:00 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:08:00 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:01 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.523s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-42bdde53-e4db-4111-935e-f83ee8c6f76e req-67873fe6-d023-4590-a5eb-e7f423b681aa tempest-ServerActionsTestOtherA-1219829658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-42bdde53-e4db-4111-935e-f83ee8c6f76e req-67873fe6-d023-4590-a5eb-e7f423b681aa tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c258e-c0de-4891-88ea-7c57374b3871]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:08:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-42bdde53-e4db-4111-935e-f83ee8c6f76e req-67873fe6-d023-4590-a5eb-e7f423b681aa tempest-ServerActionsTestOtherA-1219829658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:02 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 Jul 07 15:08:02 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Acquiring lock "cinder-b1987ff9-4eca-467a-a6c4-f6c24faee164-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Lock "cinder-b1987ff9-4eca-467a-a6c4-f6c24faee164-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:02 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-42bdde53-e4db-4111-935e-f83ee8c6f76e req-67873fe6-d023-4590-a5eb-e7f423b681aa tempest-ServerActionsTestOtherA-1219829658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" returned: 0 in 0.966s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-42bdde53-e4db-4111-935e-f83ee8c6f76e req-67873fe6-d023-4590-a5eb-e7f423b681aa tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Acquiring lock "cinder-quobyte-b1987ff9-4eca-467a-a6c4-f6c24faee164" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Lock "cinder-quobyte-b1987ff9-4eca-467a-a6c4-f6c24faee164" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-42bdde53-e4db-4111-935e-f83ee8c6f76e req-67873fe6-d023-4590-a5eb-e7f423b681aa tempest-ServerActionsTestOtherA-1219829658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e14200b-300a-41e6-bc65-6947ba09981c', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:08:03 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d9ad5e-d842-467e-9b42-fd8e740989d9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:08:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-42bdde53-e4db-4111-935e-f83ee8c6f76e req-67873fe6-d023-4590-a5eb-e7f423b681aa tempest-ServerActionsTestOtherA-1219829658 None] attachment_update completed successfully. Jul 07 15:08:03 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 Jul 07 15:08:03 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:03 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164" returned: 0 in 0.805s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:03 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164 Jul 07 15:08:03 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:04 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b1987ff9-4eca-467a-a6c4-f6c24faee164" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Lock "cinder-quobyte-b1987ff9-4eca-467a-a6c4-f6c24faee164" released by "delete_volume" :: held 1.641s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Created reservations ['f0d3608c-a116-459c-8f59-6716c23f55ff', '0c4a8dd9-9642-4066-88e2-ebe4da5e42ca', 'd5cc15ef-e62b-4583-b3dc-c13cb519e210', 'df2729c8-6a69-4beb-a025-048c2da7d373'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:04 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:08:04 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:05 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.148s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:05 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:08:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Deleted volume successfully. Jul 07 15:08:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1186320d-be66-4d80-9c56-192888ab8d3d tempest-DeleteServersTestJSON-1056998798 None] Lock "cinder-b1987ff9-4eca-467a-a6c4-f6c24faee164-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:08:12 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-6a1d3ac0-1040-4ec5-824d-b5d6fa889235 tempest-ServerActionsTestOtherA-1219829658 None] Terminate volume connection completed successfully. Jul 07 15:08:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-6a1d3ac0-1040-4ec5-824d-b5d6fa889235 tempest-ServerActionsTestOtherA-1219829658 None] Deleting attachment 6e14200b-300a-41e6-bc65-6947ba09981c. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:08:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-b049b2e4-b583-4534-b82c-c0c5c025ec95 tempest-ServerActionsTestOtherA-1219829658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-b049b2e4-b583-4534-b82c-c0c5c025ec95 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.021s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[931d19a8-ad55-4bad-b5ca-a705cc3ecfe5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:08:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-b049b2e4-b583-4534-b82c-c0c5c025ec95 tempest-ServerActionsTestOtherA-1219829658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:15 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 Jul 07 15:08:15 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:16 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-b049b2e4-b583-4534-b82c-c0c5c025ec95 tempest-ServerActionsTestOtherA-1219829658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" returned: 0 in 0.938s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-b049b2e4-b583-4534-b82c-c0c5c025ec95 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-b049b2e4-b583-4534-b82c-c0c5c025ec95 tempest-ServerActionsTestOtherA-1219829658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ee72d94-7c98-4708-b85e-61b90f93d075', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:08:16 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-243cfc25-0647-434f-b18b-34ff4c918e83 req-b049b2e4-b583-4534-b82c-c0c5c025ec95 tempest-ServerActionsTestOtherA-1219829658 None] attachment_update completed successfully. Jul 07 15:08:26 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:08:26 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=26,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:08:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Acquiring lock "cinder-8fa53bb7-d21a-407b-9bb0-f61033cdaba9-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "cinder-8fa53bb7-d21a-407b-9bb0-f61033cdaba9-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Acquiring lock "cinder-quobyte-8fa53bb7-d21a-407b-9bb0-f61033cdaba9" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "cinder-quobyte-8fa53bb7-d21a-407b-9bb0-f61033cdaba9" acquired by "delete_volume" :: waited 0.052s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:34 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16eb4e6-be50-426f-9864-1c4c72dbc5fc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:08:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:34 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 Jul 07 15:08:34 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:35 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9" returned: 0 in 1.012s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:35 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9 Jul 07 15:08:35 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:36 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8fa53bb7-d21a-407b-9bb0-f61033cdaba9" returned: 0 in 0.947s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "cinder-quobyte-8fa53bb7-d21a-407b-9bb0-f61033cdaba9" released by "delete_volume" :: held 2.092s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Created reservations ['6ff07515-1197-4fa8-820f-6063fea29577', '23967d5c-44be-4ada-ad0f-a9f2966b4dd2', '0de749ab-5953-405c-9c83-f8bb6b002eb9', '42dfea4a-751a-4565-8518-abec72269493'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:36 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:08:36 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:37 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.771s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:08:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Deleted volume successfully. Jul 07 15:08:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-036aa3d1-1354-47b8-a946-6a7ae566c843 tempest-AttachVolumeShelveTestJSON-1724477556 None] Lock "cinder-8fa53bb7-d21a-407b-9bb0-f61033cdaba9-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Flow 'volume_create_manager' (a38fa78e-83bf-4634-b2f6-579346c63541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489b9179-4a82-4dc3-8a3f-a5fe16ff239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489b9179-4a82-4dc3-8a3f-a5fe16ff239e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-385775680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7057ad5c-38a3-4056-a6eb-8d05c24db216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e3ccc15389487882517434ea9cd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:08:44Z,use_quota=True,user_id='e7dd52429bd84bc881cd7faecdceda20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe257d5-7727-4667-ad8e-3cbbc7fce226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe257d5-7727-4667-ad8e-3cbbc7fce226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ce90b2-cf81-4680-a81b-2ee7ae032009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ce90b2-cf81-4680-a81b-2ee7ae032009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7057ad5c-38a3-4056-a6eb-8d05c24db216', 'volume_name': 'volume-7057ad5c-38a3-4056-a6eb-8d05c24db216', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dd479b-3d17-48a3-8756-382e595f06de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dd479b-3d17-48a3-8756-382e595f06de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a998ca1d-52fc-46cd-bedd-46157905a979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Volume 7057ad5c-38a3-4056-a6eb-8d05c24db216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7057ad5c-38a3-4056-a6eb-8d05c24db216', 'volume_size': 1} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-385775680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7057ad5c-38a3-4056-a6eb-8d05c24db216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e3ccc15389487882517434ea9cd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:08:44Z,use_quota=True,user_id='e7dd52429bd84bc881cd7faecdceda20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Creating volume 7057ad5c-38a3-4056-a6eb-8d05c24db216 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:08:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:08:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:43 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 1073741824 Jul 07 15:08:43 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:45 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 1073741824" returned: 0 in 1.391s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:45 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 Jul 07 15:08:45 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:46 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216" returned: 0 in 0.877s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:08:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a998ca1d-52fc-46cd-bedd-46157905a979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7057ad5c-38a3-4056-a6eb-8d05c24db216', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e453603-ed1c-46ca-ab8d-90431a0d059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Volume volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 (7057ad5c-38a3-4056-a6eb-8d05c24db216): created successfully Jul 07 15:08:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e453603-ed1c-46ca-ab8d-90431a0d059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Flow 'volume_create_manager' (a38fa78e-83bf-4634-b2f6-579346c63541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:08:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5294d34c-ed82-45d2-97bf-f8d34bd47703 tempest-ServersNegativeTestJSON-808752783 None] Created volume successfully. Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Flow 'volume_create_manager' (062656ab-1aa8-47c2-ad41-7caab2b25c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43782343-f129-42a0-ad32-4789275c9ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43782343-f129-42a0-ad32-4789275c9ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1554985186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1962339-d853-4503-acbd-ffc8627884af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a45a84d60f147088ba3486361961201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:08:48Z,use_quota=True,user_id='150aedbba6b042fda2af1ac36888b171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c32e25-e14b-4f02-8802-3e92b55223cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c32e25-e14b-4f02-8802-3e92b55223cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab266985-8657-45fa-82ab-25d892da3690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab266985-8657-45fa-82ab-25d892da3690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1962339-d853-4503-acbd-ffc8627884af', 'volume_name': 'volume-a1962339-d853-4503-acbd-ffc8627884af', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ac26ad-2eab-4934-841f-edfe3fb88938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ac26ad-2eab-4934-841f-edfe3fb88938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3498e44-83b5-42cb-a947-c159e995e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:48 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Volume a1962339-d853-4503-acbd-ffc8627884af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1962339-d853-4503-acbd-ffc8627884af', 'volume_size': 1} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1554985186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1962339-d853-4503-acbd-ffc8627884af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a45a84d60f147088ba3486361961201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:08:48Z,use_quota=True,user_id='150aedbba6b042fda2af1ac36888b171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Creating volume a1962339-d853-4503-acbd-ffc8627884af {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:08:48 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:48 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af 1073741824 Jul 07 15:08:48 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Flow 'volume_create_manager' (7a471070-6bac-412b-aed2-8f1d9a58ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:08:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f2c25-db30-47d5-9b18-6292bea8cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f2c25-db30-47d5-9b18-6292bea8cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-850590981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6412de69-f5cb-4893-991e-040d32213f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e3ccc15389487882517434ea9cd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:08:49Z,use_quota=True,user_id='e7dd52429bd84bc881cd7faecdceda20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7acb3c-e6cc-477e-b78d-f57497ef8cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7acb3c-e6cc-477e-b78d-f57497ef8cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e313666b-0d3b-4340-b7be-ba32aeeab08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e313666b-0d3b-4340-b7be-ba32aeeab08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6412de69-f5cb-4893-991e-040d32213f0f', 'volume_name': 'volume-6412de69-f5cb-4893-991e-040d32213f0f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ed1440-4a73-4ce7-b3b9-ffc4c45cd0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ed1440-4a73-4ce7-b3b9-ffc4c45cd0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020adaa5-9bb2-4346-a88f-13b9ba3c7e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:49 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Volume 6412de69-f5cb-4893-991e-040d32213f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6412de69-f5cb-4893-991e-040d32213f0f', 'volume_size': 1} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:49 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af 1073741824" returned: 0 in 0.949s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:49 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af Jul 07 15:08:49 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-07f404e6-e90b-4542-a839-55c0ce6d891c req-4b235355-4bc1-4f31-bda6-b3acccb96c02 tempest-ServerActionsTestOtherA-1219829658 None] Terminate volume connection completed successfully. Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-07f404e6-e90b-4542-a839-55c0ce6d891c req-4b235355-4bc1-4f31-bda6-b3acccb96c02 tempest-ServerActionsTestOtherA-1219829658 None] Deleting attachment 2ee72d94-7c98-4708-b85e-61b90f93d075. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:08:50 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af" returned: 0 in 0.769s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-850590981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6412de69-f5cb-4893-991e-040d32213f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e3ccc15389487882517434ea9cd949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:08:49Z,use_quota=True,user_id='e7dd52429bd84bc881cd7faecdceda20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Creating volume 6412de69-f5cb-4893-991e-040d32213f0f {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:08:50 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3498e44-83b5-42cb-a947-c159e995e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1962339-d853-4503-acbd-ffc8627884af', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:50 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f 1073741824 Jul 07 15:08:50 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006669eb-b231-4c09-b2ed-f8111a0e49d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Volume volume-a1962339-d853-4503-acbd-ffc8627884af (a1962339-d853-4503-acbd-ffc8627884af): created successfully Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006669eb-b231-4c09-b2ed-f8111a0e49d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Flow 'volume_create_manager' (062656ab-1aa8-47c2-ad41-7caab2b25c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:08:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0ec5edbd-dfae-43ee-902c-b239c6d47774 tempest-TaggedAttachmentsTest-1899281623 None] Created volume successfully. Jul 07 15:08:51 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f 1073741824" returned: 0 in 0.983s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:51 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f Jul 07 15:08:51 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:52 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f" returned: 0 in 0.834s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:08:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020adaa5-9bb2-4346-a88f-13b9ba3c7e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6412de69-f5cb-4893-991e-040d32213f0f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106e471-511b-4ecf-9e5c-785878d6e765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:08:52 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Volume volume-6412de69-f5cb-4893-991e-040d32213f0f (6412de69-f5cb-4893-991e-040d32213f0f): created successfully Jul 07 15:08:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106e471-511b-4ecf-9e5c-785878d6e765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:08:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Flow 'volume_create_manager' (7a471070-6bac-412b-aed2-8f1d9a58ef56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:08:52 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c836aebc-71cb-47d4-b587-a60f841ba548 tempest-ServersNegativeTestJSON-808752783 None] Created volume successfully. Jul 07 15:08:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "cinder-6412de69-f5cb-4893-991e-040d32213f0f-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-6412de69-f5cb-4893-991e-040d32213f0f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "cinder-quobyte-6412de69-f5cb-4893-991e-040d32213f0f" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-quobyte-6412de69-f5cb-4893-991e-040d32213f0f" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a5d202-94f6-45da-a7b5-070d1caf51c8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:08:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:55 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f Jul 07 15:08:55 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:56 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:56 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f Jul 07 15:08:56 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:56 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6412de69-f5cb-4893-991e-040d32213f0f" returned: 0 in 0.834s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-quobyte-6412de69-f5cb-4893-991e-040d32213f0f" released by "delete_volume" :: held 1.741s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Created reservations ['1a653968-8e29-44b6-8e75-ea03598b6479', '00ea5d93-5d36-4a61-9127-9bc522fa7510', '93387dfb-82a4-44b1-b687-a23cfca46104', '71ac7bf5-e932-455c-817f-25af7e2e19b8'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:57 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:08:57 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "cinder-7057ad5c-38a3-4056-a6eb-8d05c24db216-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-7057ad5c-38a3-4056-a6eb-8d05c24db216-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "cinder-quobyte-7057ad5c-38a3-4056-a6eb-8d05c24db216" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-quobyte-7057ad5c-38a3-4056-a6eb-8d05c24db216" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9da9e0a-98d3-4d9c-85f8-24ef892197c4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:08:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:57 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 Jul 07 15:08:57 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:58 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.041s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:58 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:08:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Deleted volume successfully. Jul 07 15:08:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e531d49-6715-4454-9eb5-1f0a4c17ba67 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-6412de69-f5cb-4893-991e-040d32213f0f-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:08:59 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216" returned: 0 in 1.275s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:08:59 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216 Jul 07 15:08:59 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:08:59 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7057ad5c-38a3-4056-a6eb-8d05c24db216" returned: 0 in 0.793s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-quobyte-7057ad5c-38a3-4056-a6eb-8d05c24db216" released by "delete_volume" :: held 2.136s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Created reservations ['9ed1e7b5-af2c-4572-8fee-aeb1e0178695', '77d3a989-88a5-4a53-8175-80de3ff7c125', '5902b4b4-84d3-4734-b373-f04c508178b9', '91b8fe54-3549-4488-9d7b-393e81c8e944'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:08:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:00 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:09:00 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:00 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:09:00 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:00 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:09:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Deleted volume successfully. Jul 07 15:09:00 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.828s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:09:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-da28c723-d757-4dd3-92bb-d80201f2dfc5 tempest-ServersNegativeTestJSON-808752783 None] Lock "cinder-7057ad5c-38a3-4056-a6eb-8d05c24db216-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Acquiring lock "cinder-c7f38b05-e433-4fe7-b0d7-e08f06e477e3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Lock "cinder-c7f38b05-e433-4fe7-b0d7-e08f06e477e3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Acquiring lock "cinder-quobyte-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Lock "cinder-quobyte-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cb0f2b-d64d-4a18-887f-ea02545dd07a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:09:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:02 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 Jul 07 15:09:02 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:03 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" returned: 0 in 0.956s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:03 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3 Jul 07 15:09:03 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:04 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" returned: 0 in 0.773s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Lock "cinder-quobyte-c7f38b05-e433-4fe7-b0d7-e08f06e477e3" released by "delete_volume" :: held 1.792s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Created reservations ['ec0f74de-6423-40ed-be1b-0eadcc6929f5', 'b4c7ba61-302a-4b0b-a767-2aef2415bbc6', 'ddeafa38-ed69-4d31-975a-b44dbce44d7d', 'abda0c25-53fb-41ea-8224-5a6297fb34c0'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:04 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:09:04 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:05 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.060s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:05 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:09:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Deleted volume successfully. Jul 07 15:09:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c743d4d1-f484-4856-bbaf-809ec689af14 tempest-ServerActionsTestOtherA-1219829658 None] Lock "cinder-c7f38b05-e433-4fe7-b0d7-e08f06e477e3-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:14 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=42,cinder:SELECT=25,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:09:15 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Flow 'volume_create_manager' (1fe887ee-7e0e-468f-84d3-237f12651cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f3292a-9860-4771-93cd-6027de6b83d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f3292a-9860-4771-93cd-6027de6b83d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-878626703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298bf7cf-c1bd-4b2d-8390-27063f2b65dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e8eb54a2f141e0a549b3201cb09e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:21Z,use_quota=True,user_id='f9313b98fcb94f51b3a4bd13bb5ba26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c180e8e7-13a1-4662-a4bb-4bb7ee1a91cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c180e8e7-13a1-4662-a4bb-4bb7ee1a91cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a29fb0-3fdf-4c53-9d1b-993ec2f9f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a29fb0-3fdf-4c53-9d1b-993ec2f9f258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298bf7cf-c1bd-4b2d-8390-27063f2b65dd', 'volume_name': 'volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4fc42e-4511-4bee-8bb0-e1964c28fba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4fc42e-4511-4bee-8bb0-e1964c28fba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c224ea36-8de2-488d-9658-4d84b9208e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Volume 298bf7cf-c1bd-4b2d-8390-27063f2b65dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd', 'volume_size': 1} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-878626703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298bf7cf-c1bd-4b2d-8390-27063f2b65dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e8eb54a2f141e0a549b3201cb09e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:21Z,use_quota=True,user_id='f9313b98fcb94f51b3a4bd13bb5ba26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Creating volume 298bf7cf-c1bd-4b2d-8390-27063f2b65dd {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:09:21 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:09:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:21 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd 1073741824 Jul 07 15:09:21 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:22 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd 1073741824" returned: 0 in 1.456s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:23 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd Jul 07 15:09:23 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:24 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd" returned: 0 in 1.196s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] <== create_volume: return (2745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:09:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.749s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c224ea36-8de2-488d-9658-4d84b9208e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19317c99-35e3-4e5c-b4ee-cc941c5f2591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Volume volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd (298bf7cf-c1bd-4b2d-8390-27063f2b65dd): created successfully Jul 07 15:09:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19317c99-35e3-4e5c-b4ee-cc941c5f2591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Flow 'volume_create_manager' (1fe887ee-7e0e-468f-84d3-237f12651cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1588240d-1ea2-422d-ae00-c32e241d2cee tempest-VolumesTestJSON-60668222 None] Created volume successfully. Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Flow 'volume_create_manager' (8b986670-0fb0-4a7e-b898-bc127983c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7500d654-c555-41cd-a057-23e3e637bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7500d654-c555-41cd-a057-23e3e637bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558459344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaab9c49-669d-41bc-ac5d-c41fb2034c20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e8eb54a2f141e0a549b3201cb09e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:26Z,use_quota=True,user_id='f9313b98fcb94f51b3a4bd13bb5ba26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2837fc-1baa-4337-90e5-03c53e08cc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2837fc-1baa-4337-90e5-03c53e08cc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb85411-3607-4748-93a8-b8e92f6e38f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb85411-3607-4748-93a8-b8e92f6e38f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaab9c49-669d-41bc-ac5d-c41fb2034c20', 'volume_name': 'volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f62b1b-5e22-447f-95c7-2a999a5df28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f62b1b-5e22-447f-95c7-2a999a5df28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b146bf-bbab-4779-9e63-c5161dc137f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Volume aaab9c49-669d-41bc-ac5d-c41fb2034c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20', 'volume_size': 1} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558459344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaab9c49-669d-41bc-ac5d-c41fb2034c20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e8eb54a2f141e0a549b3201cb09e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:26Z,use_quota=True,user_id='f9313b98fcb94f51b3a4bd13bb5ba26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Creating volume aaab9c49-669d-41bc-ac5d-c41fb2034c20 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:09:25 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:09:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:25 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 1073741824 Jul 07 15:09:25 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:26 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 1073741824" returned: 0 in 1.211s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:27 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 Jul 07 15:09:27 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:27 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20" returned: 0 in 0.812s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b146bf-bbab-4779-9e63-c5161dc137f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c20b8d-9004-46d8-90ff-59ea79a52d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Volume volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 (aaab9c49-669d-41bc-ac5d-c41fb2034c20): created successfully Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c20b8d-9004-46d8-90ff-59ea79a52d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Flow 'volume_create_manager' (8b986670-0fb0-4a7e-b898-bc127983c45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:27 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8897a42a-ec71-4790-90fa-eb301e9b32ce tempest-VolumesTestJSON-60668222 None] Created volume successfully. Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Flow 'volume_create_manager' (b066e704-b89d-4584-99ac-0cf75737d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29102b76-722a-4520-b06f-ac4860642449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29102b76-722a-4520-b06f-ac4860642449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-236321075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a269cd7-2a36-4994-9678-00af80de16a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e8eb54a2f141e0a549b3201cb09e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:30Z,use_quota=True,user_id='f9313b98fcb94f51b3a4bd13bb5ba26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1dc46a-b1ab-424b-8ef3-cdf00dfe64e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1dc46a-b1ab-424b-8ef3-cdf00dfe64e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52166b6f-4344-4ccd-9503-75076054aae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52166b6f-4344-4ccd-9503-75076054aae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a269cd7-2a36-4994-9678-00af80de16a3', 'volume_name': 'volume-7a269cd7-2a36-4994-9678-00af80de16a3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5561781c-2d5c-454a-9bfa-3f8d33c6dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5561781c-2d5c-454a-9bfa-3f8d33c6dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de530bf9-45bb-4e82-9279-dba5a540f6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Volume 7a269cd7-2a36-4994-9678-00af80de16a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a269cd7-2a36-4994-9678-00af80de16a3', 'volume_size': 1} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-236321075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a269cd7-2a36-4994-9678-00af80de16a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57e8eb54a2f141e0a549b3201cb09e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:30Z,use_quota=True,user_id='f9313b98fcb94f51b3a4bd13bb5ba26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Creating volume 7a269cd7-2a36-4994-9678-00af80de16a3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:09:29 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:09:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:29 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 1073741824 Jul 07 15:09:29 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:30 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 1073741824" returned: 0 in 0.966s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:30 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 Jul 07 15:09:30 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:31 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3" returned: 0 in 0.716s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:09:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de530bf9-45bb-4e82-9279-dba5a540f6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a269cd7-2a36-4994-9678-00af80de16a3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd393b3-5194-4f0c-827e-56aa94cc98b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:31 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Volume volume-7a269cd7-2a36-4994-9678-00af80de16a3 (7a269cd7-2a36-4994-9678-00af80de16a3): created successfully Jul 07 15:09:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd393b3-5194-4f0c-827e-56aa94cc98b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Flow 'volume_create_manager' (b066e704-b89d-4584-99ac-0cf75737d829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-652572ee-2c15-42a7-bcf8-afd2f9b54189 tempest-VolumesTestJSON-60668222 None] Created volume successfully. Jul 07 15:09:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Acquiring lock "cinder-7a269cd7-2a36-4994-9678-00af80de16a3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Lock "cinder-7a269cd7-2a36-4994-9678-00af80de16a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Acquiring lock "cinder-quobyte-7a269cd7-2a36-4994-9678-00af80de16a3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Lock "cinder-quobyte-7a269cd7-2a36-4994-9678-00af80de16a3" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7673ab5-7ebb-4ef1-a287-53527a8b2cda]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:09:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:33 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 Jul 07 15:09:33 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:34 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3" returned: 0 in 0.846s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:34 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3 Jul 07 15:09:34 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:35 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7a269cd7-2a36-4994-9678-00af80de16a3" returned: 0 in 0.662s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Lock "cinder-quobyte-7a269cd7-2a36-4994-9678-00af80de16a3" released by "delete_volume" :: held 1.553s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Created reservations ['7264b3a8-c2a6-49e1-8e13-eea09b3d1dab', 'ddce513f-e862-4f05-9882-466d7340d738', '17004bb7-efaa-4220-a0a6-c464aeafbfb0', '186014a1-2ea1-4dde-b520-ccc34d07b668'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:35 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:09:35 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Acquiring lock "cinder-aaab9c49-669d-41bc-ac5d-c41fb2034c20-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Lock "cinder-aaab9c49-669d-41bc-ac5d-c41fb2034c20-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Acquiring lock "cinder-quobyte-aaab9c49-669d-41bc-ac5d-c41fb2034c20" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Lock "cinder-quobyte-aaab9c49-669d-41bc-ac5d-c41fb2034c20" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[094a11c9-f1dd-45e8-83cf-f160a60b6d0d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:36 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 Jul 07 15:09:36 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:36 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.828s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:09:36 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Deleted volume successfully. Jul 07 15:09:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-394788dd-a9ec-46d7-8c2a-0615311b3709 tempest-VolumesTestJSON-60668222 None] Lock "cinder-7a269cd7-2a36-4994-9678-00af80de16a3-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:37 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20" returned: 0 in 0.946s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:37 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20 Jul 07 15:09:37 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:38 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aaab9c49-669d-41bc-ac5d-c41fb2034c20" returned: 0 in 0.834s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Lock "cinder-quobyte-aaab9c49-669d-41bc-ac5d-c41fb2034c20" released by "delete_volume" :: held 1.836s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Created reservations ['ffcd150b-e073-49d7-b1c8-3951dd40b102', '331fc7dc-07d2-4dbe-85cb-31aaa7a19214', 'd7f27be2-197f-424b-b964-13d48d70a90b', 'a0adb2e0-5ec7-4028-8228-f23b7e23f88a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:38 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:09:38 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Acquiring lock "cinder-298bf7cf-c1bd-4b2d-8390-27063f2b65dd-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Lock "cinder-298bf7cf-c1bd-4b2d-8390-27063f2b65dd-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Acquiring lock "cinder-quobyte-298bf7cf-c1bd-4b2d-8390-27063f2b65dd" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Lock "cinder-quobyte-298bf7cf-c1bd-4b2d-8390-27063f2b65dd" acquired by "delete_volume" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c0f2a9-868b-4f4e-a1e3-48b1fd8778cf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:38 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd Jul 07 15:09:38 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:38 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:09:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Deleted volume successfully. Jul 07 15:09:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37dbd9a6-f58b-4b76-8091-37e4d51fedcd tempest-VolumesTestJSON-60668222 None] Lock "cinder-aaab9c49-669d-41bc-ac5d-c41fb2034c20-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:39 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd" returned: 0 in 0.869s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:39 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd Jul 07 15:09:39 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:40 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-298bf7cf-c1bd-4b2d-8390-27063f2b65dd" returned: 0 in 0.942s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Lock "cinder-quobyte-298bf7cf-c1bd-4b2d-8390-27063f2b65dd" released by "delete_volume" :: held 1.888s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Created reservations ['7a97601b-d8fe-43e9-8a81-724f119a0589', 'fb4613c4-639a-4a28-af24-c96ec8bbdf86', '7f49412d-15e7-40fc-8295-010d9c2d8135', 'b8fc51f8-2724-4f8f-9079-dc32ab071f92'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:40 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:09:40 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:41 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.754s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:41 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:09:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Deleted volume successfully. Jul 07 15:09:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2298606-00e1-4806-a500-ea0841566fa6 tempest-VolumesTestJSON-60668222 None] Lock "cinder-298bf7cf-c1bd-4b2d-8390-27063f2b65dd-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Flow 'volume_create_manager' (9e822dba-74f0-4ee0-af0d-102f12c7acf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5863fa52-ebc0-4a63-bfb6-1b776a5ad4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5863fa52-ebc0-4a63-bfb6-1b776a5ad4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1109777031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4dfe30-d726-490c-b598-4923dae231bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207e5e9dc17247ef8065a84d7c6bdbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:44Z,use_quota=True,user_id='29205121708c4a9b983077c6f2f25699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e2ecca-3927-4907-912a-dc8cde676fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e2ecca-3927-4907-912a-dc8cde676fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30be9078-7a8a-4c03-ac33-6c545f34f445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30be9078-7a8a-4c03-ac33-6c545f34f445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4dfe30-d726-490c-b598-4923dae231bb', 'volume_name': 'volume-aa4dfe30-d726-490c-b598-4923dae231bb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07227e34-7b6c-4636-84ee-11000a0edf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07227e34-7b6c-4636-84ee-11000a0edf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c55015e-9508-41d8-a4a2-823e1fa246da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Volume aa4dfe30-d726-490c-b598-4923dae231bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4dfe30-d726-490c-b598-4923dae231bb', 'volume_size': 1} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1109777031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4dfe30-d726-490c-b598-4923dae231bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207e5e9dc17247ef8065a84d7c6bdbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:09:44Z,use_quota=True,user_id='29205121708c4a9b983077c6f2f25699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Creating volume aa4dfe30-d726-490c-b598-4923dae231bb {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:09:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:09:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:43 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb 1073741824 Jul 07 15:09:43 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:44 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb 1073741824" returned: 0 in 1.039s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:44 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb Jul 07 15:09:44 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:45 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb" returned: 0 in 0.801s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:09:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c55015e-9508-41d8-a4a2-823e1fa246da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4dfe30-d726-490c-b598-4923dae231bb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694a449-44e6-4fb7-9e13-97276b9b734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:09:45 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Volume volume-aa4dfe30-d726-490c-b598-4923dae231bb (aa4dfe30-d726-490c-b598-4923dae231bb): created successfully Jul 07 15:09:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e694a449-44e6-4fb7-9e13-97276b9b734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:09:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Flow 'volume_create_manager' (9e822dba-74f0-4ee0-af0d-102f12c7acf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:09:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7912c91b-e68d-4d74-8265-647e5b2c1bd9 tempest-AttachVolumeNegativeTest-620314878 None] Created volume successfully. Jul 07 15:09:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-94c37cb9-1348-4c7c-89c8-df8821cd3e9b req-79fcef76-8138-4a06-a284-5c3a754f9865 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-94c37cb9-1348-4c7c-89c8-df8821cd3e9b req-79fcef76-8138-4a06-a284-5c3a754f9865 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f24d27b-4510-441a-afc5-65874b2a7a64]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:09:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-94c37cb9-1348-4c7c-89c8-df8821cd3e9b req-79fcef76-8138-4a06-a284-5c3a754f9865 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:49 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb Jul 07 15:09:49 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:50 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-94c37cb9-1348-4c7c-89c8-df8821cd3e9b req-79fcef76-8138-4a06-a284-5c3a754f9865 tempest-AttachVolumeNegativeTest-620314878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb" returned: 0 in 1.096s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-94c37cb9-1348-4c7c-89c8-df8821cd3e9b req-79fcef76-8138-4a06-a284-5c3a754f9865 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.128s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-94c37cb9-1348-4c7c-89c8-df8821cd3e9b req-79fcef76-8138-4a06-a284-5c3a754f9865 tempest-AttachVolumeNegativeTest-620314878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-aa4dfe30-d726-490c-b598-4923dae231bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98c5edab-8514-4597-bbaa-7bb216df12ce', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:09:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-94c37cb9-1348-4c7c-89c8-df8821cd3e9b req-79fcef76-8138-4a06-a284-5c3a754f9865 tempest-AttachVolumeNegativeTest-620314878 None] attachment_update completed successfully. Jul 07 15:09:52 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b625b328-d38d-43ce-85eb-54778faa52df tempest-GroupsV320Test-1595159701 None] Group tempest-GroupsV320Test-Group-1626251390: creating Jul 07 15:09:52 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b625b328-d38d-43ce-85eb-54778faa52df tempest-GroupsV320Test-1595159701 None] Group tempest-GroupsV320Test-Group-1626251390: created successfully Jul 07 15:09:52 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b625b328-d38d-43ce-85eb-54778faa52df tempest-GroupsV320Test-1595159701 None] Create group completed successfully. Jul 07 15:09:54 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Created reservations ['44678840-d57e-4682-bb25-870143367bb4'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:55 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:09:55 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-7d04f308-d125-4d60-b0c2-a4a3d8c27474 req-924f3ea7-064e-417a-9b4e-87a2a0de4570 tempest-TaggedAttachmentsTest-1899281623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-7d04f308-d125-4d60-b0c2-a4a3d8c27474 req-924f3ea7-064e-417a-9b4e-87a2a0de4570 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3023787d-2944-4971-abc2-060440561173]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:09:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-7d04f308-d125-4d60-b0c2-a4a3d8c27474 req-924f3ea7-064e-417a-9b4e-87a2a0de4570 tempest-TaggedAttachmentsTest-1899281623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:09:56 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af Jul 07 15:09:56 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:09:56 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.535s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:56 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:09:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-133705cd-a0a3-43be-b304-715eb8adc64a tempest-GroupsV320Test-1595159701 None] Delete group completed successfully. Jul 07 15:09:57 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Jul 07 15:09:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-7d04f308-d125-4d60-b0c2-a4a3d8c27474 req-924f3ea7-064e-417a-9b4e-87a2a0de4570 tempest-TaggedAttachmentsTest-1899281623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af" returned: 0 in 1.689s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:09:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-7d04f308-d125-4d60-b0c2-a4a3d8c27474 req-924f3ea7-064e-417a-9b4e-87a2a0de4570 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.720s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:09:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-7d04f308-d125-4d60-b0c2-a4a3d8c27474 req-924f3ea7-064e-417a-9b4e-87a2a0de4570 tempest-TaggedAttachmentsTest-1899281623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-a1962339-d853-4503-acbd-ffc8627884af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1634deb-28d8-4fe9-82cc-1d9eb05e2f17', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:09:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-7d04f308-d125-4d60-b0c2-a4a3d8c27474 req-924f3ea7-064e-417a-9b4e-87a2a0de4570 tempest-TaggedAttachmentsTest-1899281623 None] attachment_update completed successfully. Jul 07 15:09:59 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:09:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:09:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:09:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:00 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:10:00 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:01 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.277s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:10:01 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:10:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:10:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:10:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-970bb877-3932-4e78-9c58-20955c6edb19 req-28016d75-2d8e-4ba7-9538-6ef643f1fdb8 tempest-TaggedAttachmentsTest-1899281623 None] Terminate volume connection completed successfully. Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-970bb877-3932-4e78-9c58-20955c6edb19 req-28016d75-2d8e-4ba7-9538-6ef643f1fdb8 tempest-TaggedAttachmentsTest-1899281623 None] Deleting attachment c1634deb-28d8-4fe9-82cc-1d9eb05e2f17. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Flow 'volume_create_manager' (49fab94d-6cc8-449d-a80e-977a28bbb683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86edb9c0-175c-462e-b442-e09fa327056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86edb9c0-175c-462e-b442-e09fa327056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1747823245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877f9a6a-5b26-47be-9163-65f14b0c38fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5804fabb8bef4db398196f64332e7879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:07Z,use_quota=True,user_id='ddce4b5519c14fd5ba06f60d68cffae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb9d6bc-84ae-4d9b-b69d-f1ac8a55dcb3),volume_type_id=0eb9d6bc-84ae-4d9b-b69d-f1ac8a55dcb3)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b2bf3c-6ba6-4f78-82fe-eea3ec54d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b2bf3c-6ba6-4f78-82fe-eea3ec54d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faec4d70-e8a9-403f-86ee-be2e63d2617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faec4d70-e8a9-403f-86ee-be2e63d2617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877f9a6a-5b26-47be-9163-65f14b0c38fb', 'volume_name': 'volume-877f9a6a-5b26-47be-9163-65f14b0c38fb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f61459-f8c5-4052-a008-b8facc132b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f61459-f8c5-4052-a008-b8facc132b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78dfef0-08fb-497b-85e3-169058cb0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:06 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Volume 877f9a6a-5b26-47be-9163-65f14b0c38fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877f9a6a-5b26-47be-9163-65f14b0c38fb', 'volume_size': 1} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1747823245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877f9a6a-5b26-47be-9163-65f14b0c38fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5804fabb8bef4db398196f64332e7879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:07Z,use_quota=True,user_id='ddce4b5519c14fd5ba06f60d68cffae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eb9d6bc-84ae-4d9b-b69d-f1ac8a55dcb3),volume_type_id=0eb9d6bc-84ae-4d9b-b69d-f1ac8a55dcb3)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Creating volume 877f9a6a-5b26-47be-9163-65f14b0c38fb {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:10:06 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:10:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:06 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb 1073741824 Jul 07 15:10:06 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:07 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb 1073741824" returned: 0 in 1.192s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:08 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb Jul 07 15:10:08 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:09 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb" returned: 0 in 1.257s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:10:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.546s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78dfef0-08fb-497b-85e3-169058cb0430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877f9a6a-5b26-47be-9163-65f14b0c38fb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f49961-cbeb-4efd-ad45-529400938d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:09 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Volume volume-877f9a6a-5b26-47be-9163-65f14b0c38fb (877f9a6a-5b26-47be-9163-65f14b0c38fb): created successfully Jul 07 15:10:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f49961-cbeb-4efd-ad45-529400938d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Flow 'volume_create_manager' (49fab94d-6cc8-449d-a80e-977a28bbb683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:09 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2b9adbc3-7b81-43ec-80e9-b0474aefacae tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Created volume successfully. Jul 07 15:10:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:10 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:10:10 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:11 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.695s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:10:11 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-962fdab7-57cb-40f9-a9de-e8d6cdc06613 tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Retype volume completed successfully. Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Acquiring lock "cinder-877f9a6a-5b26-47be-9163-65f14b0c38fb-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "cinder-877f9a6a-5b26-47be-9163-65f14b0c38fb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Acquiring lock "cinder-quobyte-877f9a6a-5b26-47be-9163-65f14b0c38fb" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "cinder-quobyte-877f9a6a-5b26-47be-9163-65f14b0c38fb" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e92539-1b8d-4247-8a59-80239b5b651c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:10:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:12 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb Jul 07 15:10:12 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:12 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb" returned: 0 in 0.939s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:12 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb Jul 07 15:10:12 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:13 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-877f9a6a-5b26-47be-9163-65f14b0c38fb" returned: 0 in 1.071s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "cinder-quobyte-877f9a6a-5b26-47be-9163-65f14b0c38fb" released by "delete_volume" :: held 2.107s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:14 devstack cinder-volume[87257]: WARNING cinder.quota [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:10:14 devstack cinder-volume[87257]: WARNING cinder.quota [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:10:14 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Created reservations ['357b8591-151a-4387-bbe9-6c71c070b0d5', '30006d5f-9b48-4ddb-a3bd-e2f766d444a5', 'd3a2bd97-6e13-41dc-b4cb-8064cc86a29a', '7fbd017d-4587-48ee-8d68-9d8051f3d343'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:10:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:14 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:10:14 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:15 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.631s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:15 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:10:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Deleted volume successfully. Jul 07 15:10:15 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=57,cinder:INSERT=14,cinder:UPDATE=61,cinder:DELETE=7 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-48a80e4a-ece7-4c0d-8dd4-27173c593cfe tempest-VolumeRetypeWithoutMigrationTest-1075605618 None] Lock "cinder-877f9a6a-5b26-47be-9163-65f14b0c38fb-delete_volume" released by "delete_volume" :: held 4.233s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=56,cinder:SELECT=56,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Flow 'volume_create_manager' (7e4149ef-57a7-4d4f-bdee-1af4925a8cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc39935-1bf7-433f-b6f0-411e3824d58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc39935-1bf7-433f-b6f0-411e3824d58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-127827798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58904ad7-fa86-40d0-94d1-df09714132cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda4ca32aeca4c8bbeea6ca3ccaccf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:16Z,use_quota=True,user_id='aa2108e290c9473da3c0c9699833f7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee8943f-5858-48c3-9738-76ad43583182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee8943f-5858-48c3-9738-76ad43583182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4318e0-3aee-4502-8982-7f69dd9885f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4318e0-3aee-4502-8982-7f69dd9885f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58904ad7-fa86-40d0-94d1-df09714132cf', 'volume_name': 'volume-58904ad7-fa86-40d0-94d1-df09714132cf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d17dc0b-7c2f-4620-ae70-491bdbebcb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d17dc0b-7c2f-4620-ae70-491bdbebcb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9d1a78-b859-4225-bbf2-2ee8a6cc1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:16 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Volume 58904ad7-fa86-40d0-94d1-df09714132cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58904ad7-fa86-40d0-94d1-df09714132cf', 'volume_size': 1} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-127827798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58904ad7-fa86-40d0-94d1-df09714132cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda4ca32aeca4c8bbeea6ca3ccaccf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:16Z,use_quota=True,user_id='aa2108e290c9473da3c0c9699833f7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Creating volume 58904ad7-fa86-40d0-94d1-df09714132cf {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:10:16 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:10:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:17 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf 1073741824 Jul 07 15:10:17 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:18 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf 1073741824" returned: 0 in 1.873s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:18 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf Jul 07 15:10:18 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:20 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf" returned: 0 in 1.739s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] <== create_volume: return (3702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:10:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.709s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9d1a78-b859-4225-bbf2-2ee8a6cc1b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58904ad7-fa86-40d0-94d1-df09714132cf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b90e588-c54b-4f9c-884f-1f18715fa83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:20 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Volume volume-58904ad7-fa86-40d0-94d1-df09714132cf (58904ad7-fa86-40d0-94d1-df09714132cf): created successfully Jul 07 15:10:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b90e588-c54b-4f9c-884f-1f18715fa83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Flow 'volume_create_manager' (7e4149ef-57a7-4d4f-bdee-1af4925a8cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bb10c25d-e833-4be6-829c-c63b1fdc6f15 tempest-ServerRescueNegativeTestJSON-1054598658 None] Created volume successfully. Jul 07 15:10:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Acquiring lock "cinder-a1962339-d853-4503-acbd-ffc8627884af-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Lock "cinder-a1962339-d853-4503-acbd-ffc8627884af-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Acquiring lock "cinder-quobyte-a1962339-d853-4503-acbd-ffc8627884af" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Lock "cinder-quobyte-a1962339-d853-4503-acbd-ffc8627884af" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:28 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b319f1c9-57a7-41ff-8f16-b67632257b96]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:10:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:28 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af Jul 07 15:10:28 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Flow 'volume_create_manager' (2ac08713-593e-42cc-aa4d-d46a24ceda70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8667b9b6-e6c3-4b40-bcfe-0876d1cdcca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8667b9b6-e6c3-4b40-bcfe-0876d1cdcca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-249113352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60f96ee-2c92-41e7-a21e-b638babeb05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='103fd596695747fd88fef79bffae8ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:29Z,use_quota=True,user_id='99edac0d62c64562921ca2a53f778f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f49406b-1977-4220-a349-1f3081d1d367),volume_type_id=2f49406b-1977-4220-a349-1f3081d1d367)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2c591c-7eba-4d3a-8480-f99ca00d8c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2c591c-7eba-4d3a-8480-f99ca00d8c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dce7b2f-8732-4f30-bdf2-713c0b0d5e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dce7b2f-8732-4f30-bdf2-713c0b0d5e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e60f96ee-2c92-41e7-a21e-b638babeb05e', 'volume_name': 'volume-e60f96ee-2c92-41e7-a21e-b638babeb05e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b865fcf-c685-481b-babf-4eddd939d6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b865fcf-c685-481b-babf-4eddd939d6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02f2b42-17c1-4f46-bbc2-935aff07ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Volume e60f96ee-2c92-41e7-a21e-b638babeb05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e60f96ee-2c92-41e7-a21e-b638babeb05e', 'volume_size': 1} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-249113352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60f96ee-2c92-41e7-a21e-b638babeb05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='103fd596695747fd88fef79bffae8ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:29Z,use_quota=True,user_id='99edac0d62c64562921ca2a53f778f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f49406b-1977-4220-a349-1f3081d1d367),volume_type_id=2f49406b-1977-4220-a349-1f3081d1d367)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Creating volume e60f96ee-2c92-41e7-a21e-b638babeb05e {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:10:29 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:29 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e 1073741824 Jul 07 15:10:29 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:29 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af" returned: 0 in 0.994s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:29 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af Jul 07 15:10:29 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:30 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a1962339-d853-4503-acbd-ffc8627884af" returned: 0 in 0.711s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Lock "cinder-quobyte-a1962339-d853-4503-acbd-ffc8627884af" released by "delete_volume" :: held 1.762s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Created reservations ['ee54ff7a-dbe6-4594-96e6-76c4a9be5f34', '3c83e49a-4963-449e-b21c-c560715edd20', '473fd1aa-3f60-46ba-9d34-f21e84d4c5e2', '7ae25681-c3e9-4bd6-a94a-21bb33032e55'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:10:30 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e 1073741824" returned: 0 in 0.965s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:30 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e Jul 07 15:10:30 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:30 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:10:30 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:31 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e" returned: 0 in 0.875s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:31 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.866s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02f2b42-17c1-4f46-bbc2-935aff07ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e60f96ee-2c92-41e7-a21e-b638babeb05e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42a13ba-4fd8-4af4-b560-313266ef1a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Deleted volume successfully. Jul 07 15:10:31 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Volume volume-e60f96ee-2c92-41e7-a21e-b638babeb05e (e60f96ee-2c92-41e7-a21e-b638babeb05e): created successfully Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42a13ba-4fd8-4af4-b560-313266ef1a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Flow 'volume_create_manager' (2ac08713-593e-42cc-aa4d-d46a24ceda70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-662048b6-c51b-43f8-afec-b56b960822b6 tempest-TaggedAttachmentsTest-1899281623 None] Lock "cinder-a1962339-d853-4503-acbd-ffc8627884af-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3529a055-58e7-411f-a24f-971d49aebf4e tempest-VolumeTypesAccessTest-1541672873 None] Created volume successfully. Jul 07 15:10:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Acquiring lock "cinder-e60f96ee-2c92-41e7-a21e-b638babeb05e-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Lock "cinder-e60f96ee-2c92-41e7-a21e-b638babeb05e-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Acquiring lock "cinder-quobyte-e60f96ee-2c92-41e7-a21e-b638babeb05e" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Lock "cinder-quobyte-e60f96ee-2c92-41e7-a21e-b638babeb05e" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b351bf4f-4f58-472f-be0f-6d5c3730ab44]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:10:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:33 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e Jul 07 15:10:33 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:33 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e" returned: 0 in 0.934s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:33 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e Jul 07 15:10:33 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:34 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e60f96ee-2c92-41e7-a21e-b638babeb05e" returned: 0 in 0.987s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Lock "cinder-quobyte-e60f96ee-2c92-41e7-a21e-b638babeb05e" released by "delete_volume" :: held 2.042s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:35 devstack cinder-volume[87257]: WARNING cinder.quota [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1180381888 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1180381888, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:10:35 devstack cinder-volume[87257]: WARNING cinder.quota [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1180381888 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1180381888, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:10:35 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Created reservations ['5b95597e-b301-4872-bc8f-15b284dde808', 'f167b350-51db-4dea-8124-e14ffed0bb94', '500e5c13-9f09-4aa3-9599-8bca33ddd439', '089816f2-ca8c-4cf0-ba9c-921547e4b0ba'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:10:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:35 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:10:35 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:36 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.283s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:36 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:10:36 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Deleted volume successfully. Jul 07 15:10:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6981227d-97ad-4204-98b7-b2e13c2d6566 tempest-VolumeTypesAccessTest-1541672873 None] Lock "cinder-e60f96ee-2c92-41e7-a21e-b638babeb05e-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Acquiring lock "cinder-58904ad7-fa86-40d0-94d1-df09714132cf-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "cinder-58904ad7-fa86-40d0-94d1-df09714132cf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Acquiring lock "cinder-quobyte-58904ad7-fa86-40d0-94d1-df09714132cf" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "cinder-quobyte-58904ad7-fa86-40d0-94d1-df09714132cf" acquired by "delete_volume" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9615d6ad-d3a8-4e70-9f9b-c6df7d2c01e8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:10:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:42 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf Jul 07 15:10:42 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:43 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf" returned: 0 in 1.208s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:43 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf Jul 07 15:10:43 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:44 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-58904ad7-fa86-40d0-94d1-df09714132cf" returned: 0 in 0.908s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "cinder-quobyte-58904ad7-fa86-40d0-94d1-df09714132cf" released by "delete_volume" :: held 2.192s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Created reservations ['bb5e9d86-4126-4507-9b8b-906a952c0ecd', 'd93edf1b-81f0-47e9-9984-07dc63842174', 'e1d1967a-4ec2-4c20-8b0d-cba4d942eb50', 'b1169416-c416-49a0-88c8-6a3b44a279b2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:44 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:10:44 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:45 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.793s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:45 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:10:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Deleted volume successfully. Jul 07 15:10:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e7f896ff-29d8-405d-9c3d-572fc9d2f9fd tempest-ServerRescueNegativeTestJSON-1054598658 None] Lock "cinder-58904ad7-fa86-40d0-94d1-df09714132cf-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Flow 'volume_create_manager' (b55ca938-9277-4189-9d2c-edd8b0458083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a59ec1-5d06-433d-8559-8b34919bff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a59ec1-5d06-433d-8559-8b34919bff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2037516164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c129976-68d5-41b6-b1a7-68a108706ece,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bbb09af1e904960bd1bbb485e538de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:51Z,use_quota=True,user_id='885e499530a549978b027f027e7a1202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b8af9d-8d2c-47bf-9f7c-ff2c4ae5a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b8af9d-8d2c-47bf-9f7c-ff2c4ae5a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0021d79b-ec02-492f-a101-c6d56a12bd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0021d79b-ec02-492f-a101-c6d56a12bd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c129976-68d5-41b6-b1a7-68a108706ece', 'volume_name': 'volume-4c129976-68d5-41b6-b1a7-68a108706ece', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b8bdc2-964c-4bac-8a1a-a94b7085edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b8bdc2-964c-4bac-8a1a-a94b7085edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f569960e-fe3b-40b1-b9a1-a87034ccd921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Volume 4c129976-68d5-41b6-b1a7-68a108706ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c129976-68d5-41b6-b1a7-68a108706ece', 'volume_size': 1} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2037516164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c129976-68d5-41b6-b1a7-68a108706ece,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7bbb09af1e904960bd1bbb485e538de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:10:51Z,use_quota=True,user_id='885e499530a549978b027f027e7a1202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Creating volume 4c129976-68d5-41b6-b1a7-68a108706ece {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:10:50 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:10:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:50 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece 1073741824 Jul 07 15:10:50 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:51 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece 1073741824" returned: 0 in 1.091s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:52 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece Jul 07 15:10:52 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:52 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece" returned: 0 in 0.896s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:10:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f569960e-fe3b-40b1-b9a1-a87034ccd921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c129976-68d5-41b6-b1a7-68a108706ece', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df082397-a544-4004-b04e-aa38a2e0bf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:10:53 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Volume volume-4c129976-68d5-41b6-b1a7-68a108706ece (4c129976-68d5-41b6-b1a7-68a108706ece): created successfully Jul 07 15:10:53 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df082397-a544-4004-b04e-aa38a2e0bf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:10:53 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Flow 'volume_create_manager' (b55ca938-9277-4189-9d2c-edd8b0458083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:10:53 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-fa6f8ae6-c069-4a43-9b8e-e9b9d417d113 req-dbce9856-c466-4c27-9eda-5c8d5838e528 tempest-VolumesGetTestJSON-1895240156 None] Created volume successfully. Jul 07 15:10:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Acquiring lock "cinder-4c129976-68d5-41b6-b1a7-68a108706ece-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Lock "cinder-4c129976-68d5-41b6-b1a7-68a108706ece-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Acquiring lock "cinder-quobyte-4c129976-68d5-41b6-b1a7-68a108706ece" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:10:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Lock "cinder-quobyte-4c129976-68d5-41b6-b1a7-68a108706ece" acquired by "delete_volume" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:10:54 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[65035473-e485-4a07-9e8b-2357ae44919a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:10:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:54 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece Jul 07 15:10:54 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:55 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece" returned: 0 in 1.110s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:55 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece Jul 07 15:10:55 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:56 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4c129976-68d5-41b6-b1a7-68a108706ece" returned: 0 in 0.917s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Lock "cinder-quobyte-4c129976-68d5-41b6-b1a7-68a108706ece" released by "delete_volume" :: held 2.092s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG cinder.quota [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Created reservations ['c0dec290-17af-46c6-9afb-50e3f393ebe9', '28f34171-4b4a-4f9c-b261-1bb99e7cdca7', '3ce896dd-3714-4d43-8fec-39fab5dfc533', '00138482-b8cd-4ef2-88a4-c74b4f80ce5c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:10:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:10:56 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:10:56 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:10:57 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Jul 07 15:10:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.744s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:10:57 devstack cinder-volume[87257]: DEBUG cinder.manager [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:10:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Deleted volume successfully. Jul 07 15:10:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-dab5b1db-8d42-461b-9d15-13edb94154c4 req-cc7f4e57-42ab-4970-8b45-9633bd75c53a tempest-VolumesGetTestJSON-1895240156 None] Lock "cinder-4c129976-68d5-41b6-b1a7-68a108706ece-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:10:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-58b8f205-c4fe-4e1d-a5b7-8b61e9e4e6c7 req-54cf4b3a-a36f-4241-9aac-677c3b6dce63 tempest-AttachVolumeNegativeTest-620314878 None] Terminate volume connection completed successfully. Jul 07 15:10:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-58b8f205-c4fe-4e1d-a5b7-8b61e9e4e6c7 req-54cf4b3a-a36f-4241-9aac-677c3b6dce63 tempest-AttachVolumeNegativeTest-620314878 None] Deleting attachment 98c5edab-8514-4597-bbaa-7bb216df12ce. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:10:59 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:10:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:10:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:10:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:00 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:11:00 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:01 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.092s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:11:01 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:11:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:11:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:11:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cbfa634-aacb-42aa-be08-f24e93525d3b tempest-BackendsCapabilitiesAdminTestsJSON-332404442 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87257) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 15:11:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-da7d7437-5d24-4120-8dd8-8681ab85c098 tempest-BackendsCapabilitiesAdminTestsJSON-332404442 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87257) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 15:11:07 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=36,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:11:07 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=46,cinder:SELECT=24,cinder:INSERT=11,cinder:DELETE=6 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:11:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ac2aed0f-654f-495f-a952-755122cb215a tempest-GroupSnapshotsTest-408179056 None] Group tempest-GroupSnapshotsTest-Group-792106404: creating Jul 07 15:11:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ac2aed0f-654f-495f-a952-755122cb215a tempest-GroupSnapshotsTest-408179056 None] Group tempest-GroupSnapshotsTest-Group-792106404: created successfully Jul 07 15:11:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ac2aed0f-654f-495f-a952-755122cb215a tempest-GroupSnapshotsTest-408179056 None] Create group completed successfully. Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (f1f71bdb-3e0c-474b-9a5c-cf48eb07be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d26ab9-faca-463b-a303-592d8cfa13e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d26ab9-faca-463b-a303-592d8cfa13e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2053262319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efa38540-e891-4a1d-92c5-62f6e8d6622a,host='devstack@QuobyteHD#QuobyteHD',id=3f227798-46ac-4f82-82e1-da7254b1113a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:12Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f56038e6-0007-4faf-b5d6-67f373b4530f),volume_type_id=f56038e6-0007-4faf-b5d6-67f373b4530f)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f689152-d9a5-4d3f-a566-40bfb377f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f689152-d9a5-4d3f-a566-40bfb377f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524dc34c-6bfb-42f7-9776-2b25d3163fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524dc34c-6bfb-42f7-9776-2b25d3163fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f227798-46ac-4f82-82e1-da7254b1113a', 'volume_name': 'volume-3f227798-46ac-4f82-82e1-da7254b1113a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41991f96-0f39-4b45-96ca-e77a31dfc5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41991f96-0f39-4b45-96ca-e77a31dfc5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0437390-1911-4f31-8dc4-3c9b5aea57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:12 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Volume 3f227798-46ac-4f82-82e1-da7254b1113a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f227798-46ac-4f82-82e1-da7254b1113a', 'volume_size': 1} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=efa38540-e891-4a1d-92c5-62f6e8d6622a,created_at=2026-07-07T13:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2053262319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efa38540-e891-4a1d-92c5-62f6e8d6622a,host='devstack@QuobyteHD#QuobyteHD',id=3f227798-46ac-4f82-82e1-da7254b1113a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:12Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f56038e6-0007-4faf-b5d6-67f373b4530f),volume_type_id=f56038e6-0007-4faf-b5d6-67f373b4530f)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Creating volume 3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:11:12 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:11:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:12 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a 1073741824 Jul 07 15:11:12 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:13 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a 1073741824" returned: 0 in 0.977s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:13 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a Jul 07 15:11:13 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:14 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a" returned: 0 in 0.797s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:11:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0437390-1911-4f31-8dc4-3c9b5aea57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f227798-46ac-4f82-82e1-da7254b1113a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2770bc-5941-4367-89f4-0e4ca593d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Volume volume-3f227798-46ac-4f82-82e1-da7254b1113a (3f227798-46ac-4f82-82e1-da7254b1113a): created successfully Jul 07 15:11:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2770bc-5941-4367-89f4-0e4ca593d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (f1f71bdb-3e0c-474b-9a5c-cf48eb07be95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:11:14 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-72f826e9-e260-4a88-ab55-6d0d2eeec7fd tempest-GroupSnapshotsTest-408179056 None] Created volume successfully. Jul 07 15:11:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] GroupSnapshot 94bf1c44-361c-4547-9bb5-82d1abc7d1f1: creating. Jul 07 15:11:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Group snapshot 94bf1c44-361c-4547-9bb5-82d1abc7d1f1: creating. {{(pid=87257) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 15:11:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Creating offline snapshot 662f639e-80e5-4130-aea5-014047409a67 of volume 3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:11:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08d5ed6-2194-458d-b379-ee1f481eda2f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:15 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a Jul 07 15:11:15 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:16 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a" returned: 0 in 0.922s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:16 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 1G Jul 07 15:11:16 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:16 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 1G" returned: 0 in 0.949s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f227798-46ac-4f82-82e1-da7254b1113a -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:17 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f227798-46ac-4f82-82e1-da7254b1113a -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 Jul 07 15:11:17 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:17 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f227798-46ac-4f82-82e1-da7254b1113a -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67" returned: 0 in 0.795s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:17 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:11:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:17 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 Jul 07 15:11:17 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:18 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67" returned: 0 in 0.766s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:18 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.info Jul 07 15:11:18 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:19 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.info" returned: 0 in 0.705s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:19 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:11:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:19 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.info Jul 07 15:11:19 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:20 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.info" returned: 0 in 0.741s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.989s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fc5bc582-42ab-4fd1-b46a-b15ccbbcc4c4 tempest-GroupSnapshotsTest-408179056 None] group_snapshot 94bf1c44-361c-4547-9bb5-82d1abc7d1f1: created successfully Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-662f639e-80e5-4130-aea5-014047409a67-7e819d25-c77e-46f0-a26b-749c8c07a4ac" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-662f639e-80e5-4130-aea5-014047409a67-7e819d25-c77e-46f0-a26b-749c8c07a4ac" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Creating volume 7e819d25-c77e-46f0-a26b-749c8c07a4ac from snapshot 662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-7e819d25-c77e-46f0-a26b-749c8c07a4ac" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-7e819d25-c77e-46f0-a26b-749c8c07a4ac" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] snapshot: 662f639e-80e5-4130-aea5-014047409a67, volume: 7e819d25-c77e-46f0-a26b-749c8c07a4ac, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed63fc3-2205-46e0-abef-6d4a9502a0b8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:22 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 Jul 07 15:11:22 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:23 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67" returned: 0 in 1.151s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f227798-46ac-4f82-82e1-da7254b1113a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:11:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:11:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:11:23 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c968d5e-7955-4b0f-b229-2dc27c064f8d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:23 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a Jul 07 15:11:23 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:24 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a" returned: 0 in 1.060s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:24 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:11:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:24 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac Jul 07 15:11:24 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:31 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac" returned: 0 in 6.887s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a50b7-0e99-49bf-920d-e57c53d5a2b0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:31 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a Jul 07 15:11:31 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:31 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:11:31 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:11:32 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a" returned: 0 in 1.200s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:32 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:11:32 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Converted 1024.00 MB image at 148.66 MB/s Jul 07 15:11:32 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:11:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:32 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac Jul 07 15:11:32 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:33 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac" returned: 0 in 0.905s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-7e819d25-c77e-46f0-a26b-749c8c07a4ac" released by "_copy_volume_from_snapshot" :: held 11.339s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:11:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-662f639e-80e5-4130-aea5-014047409a67-7e819d25-c77e-46f0-a26b-749c8c07a4ac" released by "_create_volume_from_snapshot" :: held 11.392s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:11:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.413s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3d8994b4-954a-4526-ae07-8837d7561266 tempest-GroupSnapshotsTest-408179056 None] Create group from source-snapshot-94bf1c44-361c-4547-9bb5-82d1abc7d1f1 completed successfully. Jul 07 15:11:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-7e819d25-c77e-46f0-a26b-749c8c07a4ac" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:11:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-7e819d25-c77e-46f0-a26b-749c8c07a4ac" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:11:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[deee515b-587d-40af-9a52-443199afab28]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:35 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac Jul 07 15:11:35 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:36 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac" returned: 0 in 1.122s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:36 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac Jul 07 15:11:36 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:37 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7e819d25-c77e-46f0-a26b-749c8c07a4ac" returned: 0 in 1.032s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-7e819d25-c77e-46f0-a26b-749c8c07a4ac" released by "delete_volume" :: held 2.222s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['c927dca4-34d9-492a-ba4f-b3fef5a08472'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:11:37 devstack cinder-volume[87257]: WARNING cinder.quota [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1199356154 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1199356154, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:11:37 devstack cinder-volume[87257]: WARNING cinder.quota [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1199356154 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1199356154, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['2acc73cf-d8fa-4213-86cf-52dc78997969', '7d986cb4-99b6-43d8-b7b9-b87a09df52a1', 'af4717b8-1e8a-4c7d-bd9e-ca2a8dc5fadd', '24fe1356-11ca-4269-a04e-2821635bbb04'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:37 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:11:37 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:38 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.677s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:11:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-add4a5e3-0009-4d21-90e8-a3251bd8b359 tempest-GroupSnapshotsTest-408179056 None] Delete group completed successfully. Jul 07 15:11:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] group_snapshot 94bf1c44-361c-4547-9bb5-82d1abc7d1f1: deleting Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] group_snapshot 94bf1c44-361c-4547-9bb5-82d1abc7d1f1: deleting {{(pid=87257) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-3f227798-46ac-4f82-82e1-da7254b1113a" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-3f227798-46ac-4f82-82e1-da7254b1113a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-662f639e-80e5-4130-aea5-014047409a67" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-662f639e-80e5-4130-aea5-014047409a67" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Deleting offline snapshot 662f639e-80e5-4130-aea5-014047409a67 of volume 3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] snapshot_file for this snap is: volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1f6c19-ae5e-4f4f-9ca9-0850302e299a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:39 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 Jul 07 15:11:39 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:39 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67" returned: 0 in 0.873s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f227798-46ac-4f82-82e1-da7254b1113a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:11:39 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77377cc-156f-4cd4-aa97-7510f503a711]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:40 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a Jul 07 15:11:40 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:41 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a" returned: 0 in 1.160s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:41 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 Jul 07 15:11:41 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:42 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67" returned: 0 in 1.334s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:42 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67 Jul 07 15:11:42 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:43 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a.662f639e-80e5-4130-aea5-014047409a67" returned: 0 in 0.962s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-662f639e-80e5-4130-aea5-014047409a67" released by "_delete_snapshot" :: held 4.491s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:11:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-3f227798-46ac-4f82-82e1-da7254b1113a" released by "delete_snapshot" :: held 4.522s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:11:43 devstack cinder-volume[87257]: WARNING cinder.quota [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1199356154 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1199356154, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:11:43 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['2a0d78bc-c6a9-45b3-b781-d6845e012c48', '1cc46b9d-2eb6-4c74-9c25-cc35e1d8f33d', '31ac841f-b16d-4cf6-b8e0-954df19041b8', '45da9933-8da5-41e1-bf15-e3d20327d885'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:11:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0d03057d-5f00-408c-a945-160096376a96 tempest-GroupSnapshotsTest-408179056 None] group_snapshot 94bf1c44-361c-4547-9bb5-82d1abc7d1f1: deleted successfully Jul 07 15:11:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-3f227798-46ac-4f82-82e1-da7254b1113a" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:11:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-3f227798-46ac-4f82-82e1-da7254b1113a" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:11:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17f86d0-de6c-456d-b779-d3316928eaaa]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:11:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:44 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a Jul 07 15:11:44 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:45 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a" returned: 0 in 0.782s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:45 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a Jul 07 15:11:45 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:46 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3f227798-46ac-4f82-82e1-da7254b1113a" returned: 0 in 0.762s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-3f227798-46ac-4f82-82e1-da7254b1113a" released by "delete_volume" :: held 1.641s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['2d4fe322-6c02-4873-97ef-321424a0d5af'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:11:46 devstack cinder-volume[87257]: WARNING cinder.db.sqlalchemy.api [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1199356154'] Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['d963eeab-d11c-4715-bb0c-fbeb8fe2f052', '84bf217b-2cfd-4a92-91ee-2f186d2bb5bd', 'cd069f96-740c-48ae-bde3-ff843f2986d8', 'cbe8f938-17fb-41dd-98d1-e2d09132cdd6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:46 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:11:46 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:47 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.253s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:47 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:11:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7d1aa8bf-2f81-4c57-b225-3e0f7c3bb6e8 tempest-GroupSnapshotsTest-408179056 None] Delete group completed successfully. Jul 07 15:11:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d27d1e59-f63f-4b40-9d11-1c0decc9264c tempest-GroupSnapshotsTest-408179056 None] Group tempest-GroupSnapshotsTest-Group-1580453972: creating Jul 07 15:11:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d27d1e59-f63f-4b40-9d11-1c0decc9264c tempest-GroupSnapshotsTest-408179056 None] Group tempest-GroupSnapshotsTest-Group-1580453972: created successfully Jul 07 15:11:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d27d1e59-f63f-4b40-9d11-1c0decc9264c tempest-GroupSnapshotsTest-408179056 None] Create group completed successfully. Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (b571bba9-f85f-489a-840b-316631c1a685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7dcd8-f27f-4e01-a034-01f8d5ece4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7dcd8-f27f-4e01-a034-01f8d5ece4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-491818641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a7149eb-fc9c-46db-a401-0d669d856777,host='devstack@QuobyteHD#QuobyteHD',id=0819d3ff-44b5-4468-86a2-96049f661f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:50Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26db02f8-a6c0-4f60-b363-e21cf0454950),volume_type_id=26db02f8-a6c0-4f60-b363-e21cf0454950)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86bed90-1a42-4b04-9151-aa42cf8683d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86bed90-1a42-4b04-9151-aa42cf8683d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3142ee-cb72-41a3-bf49-1e6f292404ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3142ee-cb72-41a3-bf49-1e6f292404ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0819d3ff-44b5-4468-86a2-96049f661f70', 'volume_name': 'volume-0819d3ff-44b5-4468-86a2-96049f661f70', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36924d19-e77b-4210-84e5-9a444f3b79fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36924d19-e77b-4210-84e5-9a444f3b79fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14a8ef-07ba-4ab7-be24-07afc033ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Volume 0819d3ff-44b5-4468-86a2-96049f661f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0819d3ff-44b5-4468-86a2-96049f661f70', 'volume_size': 1} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a7149eb-fc9c-46db-a401-0d669d856777,created_at=2026-07-07T13:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-491818641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a7149eb-fc9c-46db-a401-0d669d856777,host='devstack@QuobyteHD#QuobyteHD',id=0819d3ff-44b5-4468-86a2-96049f661f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:50Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26db02f8-a6c0-4f60-b363-e21cf0454950),volume_type_id=26db02f8-a6c0-4f60-b363-e21cf0454950)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Creating volume 0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:11:50 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:11:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:50 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 1073741824 Jul 07 15:11:50 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:52 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 1073741824" returned: 0 in 2.232s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:52 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 Jul 07 15:11:52 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:54 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70" returned: 0 in 2.136s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] <== create_volume: return (4440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:11:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.446s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f14a8ef-07ba-4ab7-be24-07afc033ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0819d3ff-44b5-4468-86a2-96049f661f70', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e76aa3f-8399-43d5-9dae-c81937798287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:54 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Volume volume-0819d3ff-44b5-4468-86a2-96049f661f70 (0819d3ff-44b5-4468-86a2-96049f661f70): created successfully Jul 07 15:11:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e76aa3f-8399-43d5-9dae-c81937798287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (b571bba9-f85f-489a-840b-316631c1a685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:11:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0e8be6ef-b008-4a80-8143-28cf65ca89bf tempest-GroupSnapshotsTest-408179056 None] Created volume successfully. Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (7979069f-59c0-4971-9cd8-a4fc034267b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5758e83e-7b4e-4270-a5fb-d171f0e76aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5758e83e-7b4e-4270-a5fb-d171f0e76aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1263376193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff526a98-7be9-4e3d-9e01-9e4349954dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:55Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc7593-2f46-4d52-b5a7-41849be48947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc7593-2f46-4d52-b5a7-41849be48947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232c7686-0b07-4858-8fbb-4efdc59448bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232c7686-0b07-4858-8fbb-4efdc59448bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff526a98-7be9-4e3d-9e01-9e4349954dcb', 'volume_name': 'volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9caf8a8f-a6a1-42db-8e12-6b8918f75868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9caf8a8f-a6a1-42db-8e12-6b8918f75868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8e1df7-eda9-4465-be96-fea221ccb213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:55 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Volume ff526a98-7be9-4e3d-9e01-9e4349954dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb', 'volume_size': 1} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1263376193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff526a98-7be9-4e3d-9e01-9e4349954dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:55Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Creating volume ff526a98-7be9-4e3d-9e01-9e4349954dcb {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:11:55 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:11:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:55 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb 1073741824 Jul 07 15:11:55 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:56 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb 1073741824" returned: 0 in 1.175s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:56 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb Jul 07 15:11:56 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (d8904aef-771c-4e35-8e8c-c6b0b3075265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7437f-e96e-41a7-9be9-d4c65dcdd142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7437f-e96e-41a7-9be9-d4c65dcdd142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874715253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a7149eb-fc9c-46db-a401-0d669d856777,host='devstack@QuobyteHD#QuobyteHD',id=28369593-d981-4cfe-91c1-1a50c54bb3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:57Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26db02f8-a6c0-4f60-b363-e21cf0454950),volume_type_id=26db02f8-a6c0-4f60-b363-e21cf0454950)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42755ae-eed0-45d9-803b-9021d5238972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42755ae-eed0-45d9-803b-9021d5238972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a3a51e-c7ef-4c57-902d-456bdfdfeda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a3a51e-c7ef-4c57-902d-456bdfdfeda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28369593-d981-4cfe-91c1-1a50c54bb3db', 'volume_name': 'volume-28369593-d981-4cfe-91c1-1a50c54bb3db', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21393ca-33a3-46ba-817f-2ed4e387ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21393ca-33a3-46ba-817f-2ed4e387ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e95e0f4-ecff-47e1-b958-35cc3022086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:57 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Volume 28369593-d981-4cfe-91c1-1a50c54bb3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28369593-d981-4cfe-91c1-1a50c54bb3db', 'volume_size': 1} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:57 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb" returned: 0 in 1.120s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] <== create_volume: return (2365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a7149eb-fc9c-46db-a401-0d669d856777,created_at=2026-07-07T13:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874715253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a7149eb-fc9c-46db-a401-0d669d856777,host='devstack@QuobyteHD#QuobyteHD',id=28369593-d981-4cfe-91c1-1a50c54bb3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:11:57Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26db02f8-a6c0-4f60-b363-e21cf0454950),volume_type_id=26db02f8-a6c0-4f60-b363-e21cf0454950)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Creating volume 28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:11:57 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8e1df7-eda9-4465-be96-fea221ccb213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83452e7a-6f0c-4094-9d36-36107440ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:11:57 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db 1073741824 Jul 07 15:11:57 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:57 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Volume volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb (ff526a98-7be9-4e3d-9e01-9e4349954dcb): created successfully Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83452e7a-6f0c-4094-9d36-36107440ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:11:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (7979069f-59c0-4971-9cd8-a4fc034267b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:11:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8c7aad24-85d3-4ae8-88d2-0c848518a42f tempest-VolumesActionsTest-1175323602 None] Created volume successfully. Jul 07 15:11:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c92d32f4-f151-4a05-9a06-dbb2b2ab876d tempest-VolumesActionsTest-1175323602 None] Acquiring lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb" by "attach_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:11:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c92d32f4-f151-4a05-9a06-dbb2b2ab876d tempest-VolumesActionsTest-1175323602 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb" acquired by "attach_volume" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:11:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c92d32f4-f151-4a05-9a06-dbb2b2ab876d tempest-VolumesActionsTest-1175323602 None] Attaching volume ff526a98-7be9-4e3d-9e01-9e4349954dcb to instance 1ac09ee0-c01e-41f5-b401-69181bb31db5 at mountpoint /dev/vdb on host None. Jul 07 15:11:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c92d32f4-f151-4a05-9a06-dbb2b2ab876d tempest-VolumesActionsTest-1175323602 None] Attach volume completed successfully. Jul 07 15:11:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c92d32f4-f151-4a05-9a06-dbb2b2ab876d tempest-VolumesActionsTest-1175323602 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb" released by "attach_volume" :: held 0.211s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:11:58 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db 1073741824" returned: 0 in 1.379s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:11:59 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db Jul 07 15:11:59 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:11:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-47114e07-d43c-4571-8285-d6b16276f30b tempest-VolumesActionsTest-1694010776 None] Terminate volume connection completed successfully. Jul 07 15:11:59 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Jul 07 15:11:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db" returned: 0 in 0.968s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:11:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] <== create_volume: return (2426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:11:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:11:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e95e0f4-ecff-47e1-b958-35cc3022086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28369593-d981-4cfe-91c1-1a50c54bb3db', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075bb700-1f8d-42f1-9e84-da949e565f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:00 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Volume volume-28369593-d981-4cfe-91c1-1a50c54bb3db (28369593-d981-4cfe-91c1-1a50c54bb3db): created successfully Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075bb700-1f8d-42f1-9e84-da949e565f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:00 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:00 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (d8904aef-771c-4e35-8e8c-c6b0b3075265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-982d39fa-bec3-4af3-ba80-d92af90bbf17 tempest-GroupSnapshotsTest-408179056 None] Created volume successfully. Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47114e07-d43c-4571-8285-d6b16276f30b tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-detach_volume" by "detach_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47114e07-d43c-4571-8285-d6b16276f30b tempest-VolumesActionsTest-1694010776 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-47114e07-d43c-4571-8285-d6b16276f30b tempest-VolumesActionsTest-1694010776 None] Detaching volume ff526a98-7be9-4e3d-9e01-9e4349954dcb from instance 1ac09ee0-c01e-41f5-b401-69181bb31db5. Jul 07 15:12:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-47114e07-d43c-4571-8285-d6b16276f30b tempest-VolumesActionsTest-1694010776 None] Detach volume completed successfully. Jul 07 15:12:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47114e07-d43c-4571-8285-d6b16276f30b tempest-VolumesActionsTest-1694010776 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c3df23f2-b4d8-4f35-980d-6f95ba293ab3 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-detach_volume" by "detach_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c3df23f2-b4d8-4f35-980d-6f95ba293ab3 tempest-VolumesActionsTest-1175323602 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-detach_volume" acquired by "detach_volume" :: waited 0.059s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c3df23f2-b4d8-4f35-980d-6f95ba293ab3 tempest-VolumesActionsTest-1175323602 None] Volume detach called, but volume not attached. Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c3df23f2-b4d8-4f35-980d-6f95ba293ab3 tempest-VolumesActionsTest-1175323602 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d7325818-cc48-4a5f-b4a7-574eb9ffedc2 tempest-GroupSnapshotsTest-408179056 None] Update group completed successfully. Jul 07 15:12:01 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.229s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Acquiring lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Acquiring lock "cinder-quobyte-ff526a98-7be9-4e3d-9e01-9e4349954dcb" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Lock "cinder-quobyte-ff526a98-7be9-4e3d-9e01-9e4349954dcb" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39b03ed-4360-4331-8056-01c89627c0e0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:02 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb Jul 07 15:12:02 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:02 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1a85e026-72c1-4e1d-93a3-836923c383b7 tempest-GroupSnapshotsTest-408179056 None] Update group completed successfully. Jul 07 15:12:03 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb" returned: 0 in 1.225s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:03 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb Jul 07 15:12:03 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9e00ba0a-7067-4b58-84f2-891b43d21a81 tempest-GroupSnapshotsTest-408179056 None] Update group completed successfully. Jul 07 15:12:04 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ff526a98-7be9-4e3d-9e01-9e4349954dcb" returned: 0 in 1.009s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Lock "cinder-quobyte-ff526a98-7be9-4e3d-9e01-9e4349954dcb" released by "delete_volume" :: held 2.278s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Created reservations ['37568a1a-8f5e-417e-b77c-08cee28e19fd', '0cb4c55c-f646-4d83-b85e-ffb60b790d10', 'fd64718f-5b57-4b86-bfcf-ceb3000686dc', '975b17e8-fe06-4dda-b449-aa82efb773cb'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:04 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:04 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-acb624ac-e292-444b-8e3b-031a0c6e25f1 tempest-GroupSnapshotsTest-408179056 None] Update group completed successfully. Jul 07 15:12:05 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.145s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:05 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Deleted volume successfully. Jul 07 15:12:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f9dd9853-2304-45e4-95bc-790d09eff31f tempest-VolumesActionsTest-1175323602 None] Lock "cinder-ff526a98-7be9-4e3d-9e01-9e4349954dcb-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] GroupSnapshot 2239b382-0acf-49ca-8b79-4553b1f151f1: creating. Jul 07 15:12:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Group snapshot 2239b382-0acf-49ca-8b79-4553b1f151f1: creating. {{(pid=87257) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 15:12:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Creating offline snapshot 14433540-0d65-4fe3-874b-be6d6f56802c of volume 28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:12:06 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8756c747-2411-4646-902e-c4a844477087]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:06 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db Jul 07 15:12:06 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:07 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db" returned: 0 in 0.867s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:07 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c 1G Jul 07 15:12:07 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:08 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c 1G" returned: 0 in 0.890s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28369593-d981-4cfe-91c1-1a50c54bb3db -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:08 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28369593-d981-4cfe-91c1-1a50c54bb3db -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c Jul 07 15:12:08 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:09 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28369593-d981-4cfe-91c1-1a50c54bb3db -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c" returned: 0 in 0.696s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:09 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:12:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:09 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c Jul 07 15:12:09 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:09 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c" returned: 0 in 0.628s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:09 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.info Jul 07 15:12:09 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:10 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.info" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:10 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:12:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:10 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.info Jul 07 15:12:10 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:11 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.info" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.531s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Creating offline snapshot 7e5deaa9-4b31-40f8-8d11-b680318c8792 of volume 0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3332169-9246-42b5-b88a-948e081c88b5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:11 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 Jul 07 15:12:11 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:11 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70" returned: 0 in 0.759s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:12 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 1G Jul 07 15:12:12 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:12 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 1G" returned: 0 in 0.963s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0819d3ff-44b5-4468-86a2-96049f661f70 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:13 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0819d3ff-44b5-4468-86a2-96049f661f70 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 Jul 07 15:12:13 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:13 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0819d3ff-44b5-4468-86a2-96049f661f70 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792" returned: 0 in 0.921s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:13 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:12:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:13 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 Jul 07 15:12:13 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:13 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (4cc2e9ba-a64e-4ca9-9aed-dfe688a9351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a32d3b5-ab44-49d0-b6df-2ad9a5264cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a32d3b5-ab44-49d0-b6df-2ad9a5264cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1446369347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4634c17-9b42-47a0-89bf-207adc0883eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:14Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd29218-f4ed-4633-9e60-326fdccd4fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd29218-f4ed-4633-9e60-326fdccd4fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa454081-6e9d-4362-9970-ea8b243ef76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa454081-6e9d-4362-9970-ea8b243ef76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4634c17-9b42-47a0-89bf-207adc0883eb', 'volume_name': 'volume-c4634c17-9b42-47a0-89bf-207adc0883eb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eb7598-c91f-4a80-8e43-7b489d7e2d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eb7598-c91f-4a80-8e43-7b489d7e2d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb6525-3049-404f-b083-7baf180ee771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Volume c4634c17-9b42-47a0-89bf-207adc0883eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4634c17-9b42-47a0-89bf-207adc0883eb', 'volume_size': 1} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Flow 'volume_create_manager' (02b70f88-b0ad-49f8-87da-de1994a4e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba796819-cdcf-4763-9791-25ba28483479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba796819-cdcf-4763-9791-25ba28483479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1982458925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f381410f-e268-4e07-bde5-01c974b019f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a065e1bac4a54dbc83a6ee8b4c68a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:14Z,use_quota=True,user_id='66a0d23373b24cb985f2f966c31afaac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0483c6cb-13e8-481e-805a-29e506537638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0483c6cb-13e8-481e-805a-29e506537638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce6537e-0cd1-4bb2-a266-10881a451ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce6537e-0cd1-4bb2-a266-10881a451ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f381410f-e268-4e07-bde5-01c974b019f0', 'volume_name': 'volume-f381410f-e268-4e07-bde5-01c974b019f0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5985ff11-da7b-47c4-95ba-168d646ee13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5985ff11-da7b-47c4-95ba-168d646ee13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f68acc-6223-494e-81ca-e5256cfd51fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Volume f381410f-e268-4e07-bde5-01c974b019f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f381410f-e268-4e07-bde5-01c974b019f0', 'volume_size': 1} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Flow 'volume_create_manager' (ff604444-c9a8-48cc-b803-faab85fd7463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c768c343-a685-4487-ae75-a708969d77d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c768c343-a685-4487-ae75-a708969d77d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-53397532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f66807f-dc81-4cfc-a437-ee8f746bd77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207e5e9dc17247ef8065a84d7c6bdbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:14Z,use_quota=True,user_id='29205121708c4a9b983077c6f2f25699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f17792-73f7-4376-9aec-92a88f8e0d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f17792-73f7-4376-9aec-92a88f8e0d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ee7efc-3537-44e4-b924-af0bbc455d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ee7efc-3537-44e4-b924-af0bbc455d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f66807f-dc81-4cfc-a437-ee8f746bd77e', 'volume_name': 'volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dac955a-e311-4dd6-9ffb-68442cd0173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dac955a-e311-4dd6-9ffb-68442cd0173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098b48a5-3628-48cf-ba68-c97a89582852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Volume 8f66807f-dc81-4cfc-a437-ee8f746bd77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e', 'volume_size': 1} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:14 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:14 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.info Jul 07 15:12:14 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:15 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.info" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:15 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:12:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:15 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.info Jul 07 15:12:15 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:16 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.info" returned: 0 in 0.659s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.869s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.973s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1446369347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4634c17-9b42-47a0-89bf-207adc0883eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:14Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Creating volume c4634c17-9b42-47a0-89bf-207adc0883eb {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:16 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:16 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb 1073741824 Jul 07 15:12:16 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:16 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2400f67c-7100-44a2-82e1-75c710482dda tempest-GroupSnapshotsTest-408179056 None] group_snapshot 2239b382-0acf-49ca-8b79-4553b1f151f1: created successfully Jul 07 15:12:16 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb 1073741824" returned: 0 in 0.799s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:16 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb Jul 07 15:12:16 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:17 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] group_snapshot 2239b382-0acf-49ca-8b79-4553b1f151f1: deleting Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] group_snapshot 2239b382-0acf-49ca-8b79-4553b1f151f1: deleting {{(pid=87257) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-28369593-d981-4cfe-91c1-1a50c54bb3db" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-28369593-d981-4cfe-91c1-1a50c54bb3db" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-14433540-0d65-4fe3-874b-be6d6f56802c" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-14433540-0d65-4fe3-874b-be6d6f56802c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Deleting offline snapshot 14433540-0d65-4fe3-874b-be6d6f56802c of volume 28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] snapshot_file for this snap is: volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9eadc9-f9b1-459f-91cd-d7ed24032b25]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:17 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c Jul 07 15:12:17 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:17 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb" returned: 0 in 0.670s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.392s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1982458925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f381410f-e268-4e07-bde5-01c974b019f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a065e1bac4a54dbc83a6ee8b4c68a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:14Z,use_quota=True,user_id='66a0d23373b24cb985f2f966c31afaac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Creating volume f381410f-e268-4e07-bde5-01c974b019f0 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:17 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:17 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 1073741824 Jul 07 15:12:17 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb6525-3049-404f-b083-7baf180ee771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4634c17-9b42-47a0-89bf-207adc0883eb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2178d363-46a9-4f02-9e29-d2c8fb7a0ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:17 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Volume volume-c4634c17-9b42-47a0-89bf-207adc0883eb (c4634c17-9b42-47a0-89bf-207adc0883eb): created successfully Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2178d363-46a9-4f02-9e29-d2c8fb7a0ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (4cc2e9ba-a64e-4ca9-9aed-dfe688a9351d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:17 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1b7cef1a-6786-40f0-821f-44d102bc52fb tempest-VolumesActionsTest-1175323602 None] Created volume successfully. Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-c4634c17-9b42-47a0-89bf-207adc0883eb-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-c4634c17-9b42-47a0-89bf-207adc0883eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-quobyte-c4634c17-9b42-47a0-89bf-207adc0883eb" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-c4634c17-9b42-47a0-89bf-207adc0883eb" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbda615-5ed6-49fd-92a7-e173678828c0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:18 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb Jul 07 15:12:18 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:18 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c" returned: 0 in 0.841s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28369593-d981-4cfe-91c1-1a50c54bb3db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c00ad3-d091-4ed1-b136-27b0cfb86730]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:18 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db Jul 07 15:12:18 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:18 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 1073741824" returned: 0 in 0.868s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:18 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 Jul 07 15:12:18 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:18 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb" returned: 0 in 0.799s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:18 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb Jul 07 15:12:18 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:19 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db" returned: 0 in 0.833s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:19 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c Jul 07 15:12:19 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:19 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0" returned: 0 in 0.667s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.789s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-53397532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f66807f-dc81-4cfc-a437-ee8f746bd77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207e5e9dc17247ef8065a84d7c6bdbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:14Z,use_quota=True,user_id='29205121708c4a9b983077c6f2f25699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Creating volume 8f66807f-dc81-4cfc-a437-ee8f746bd77e {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:19 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:19 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e 1073741824 Jul 07 15:12:19 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f68acc-6223-494e-81ca-e5256cfd51fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f381410f-e268-4e07-bde5-01c974b019f0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9653ad00-a462-4bd2-99f5-92e3d9fa914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:19 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Volume volume-f381410f-e268-4e07-bde5-01c974b019f0 (f381410f-e268-4e07-bde5-01c974b019f0): created successfully Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9653ad00-a462-4bd2-99f5-92e3d9fa914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Flow 'volume_create_manager' (02b70f88-b0ad-49f8-87da-de1994a4e252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9c2a0b9d-f07e-4b86-a1bd-c6e4c2535f86 tempest-AttachVolumeTestJSON-1298375289 None] Created volume successfully. Jul 07 15:12:19 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c4634c17-9b42-47a0-89bf-207adc0883eb" returned: 0 in 0.688s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-c4634c17-9b42-47a0-89bf-207adc0883eb" released by "delete_volume" :: held 1.533s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Created reservations ['e6e08734-62bb-4a3f-8675-5f70fb7e00ca', '75863692-1ac6-435b-95a5-60b887c68526', '95cac249-f7ef-488c-8f4b-a946ee601fe4', '02b21ce6-a472-457e-9e66-a977c29d54bd'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:19 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:19 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:19 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c" returned: 0 in 0.816s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:19 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c Jul 07 15:12:19 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:20 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e 1073741824" returned: 0 in 0.883s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:20 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e Jul 07 15:12:20 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:20 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Deleted volume successfully. Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ccb9aca2-81b8-4eca-941f-bf90ddbf0092 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-c4634c17-9b42-47a0-89bf-207adc0883eb-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:20 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db.14433540-0d65-4fe3-874b-be6d6f56802c" returned: 0 in 0.875s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-14433540-0d65-4fe3-874b-be6d6f56802c" released by "_delete_snapshot" :: held 3.488s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-28369593-d981-4cfe-91c1-1a50c54bb3db" released by "delete_snapshot" :: held 3.527s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-0819d3ff-44b5-4468-86a2-96049f661f70" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (8b07c7e8-0786-43d7-977d-da3979d0f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6671871f-31aa-4c92-a337-298c49b943ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-0819d3ff-44b5-4468-86a2-96049f661f70" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-7e5deaa9-4b31-40f8-8d11-b680318c8792" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6671871f-31aa-4c92-a337-298c49b943ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-480623084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39bb849-0b34-4b55-b476-c112b7c5d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:21Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03062fb-e34b-46ef-adbd-9d37d045d3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03062fb-e34b-46ef-adbd-9d37d045d3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18be7214-a5fe-4f1f-b558-dbda57de4a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18be7214-a5fe-4f1f-b558-dbda57de4a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39bb849-0b34-4b55-b476-c112b7c5d7f0', 'volume_name': 'volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad76e293-d004-44c8-b5dd-4095f42dc889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad76e293-d004-44c8-b5dd-4095f42dc889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269b198a-1785-41d7-a9fa-9f91d7200cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Volume b39bb849-0b34-4b55-b476-c112b7c5d7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0', 'volume_size': 1} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-7e5deaa9-4b31-40f8-8d11-b680318c8792" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Deleting offline snapshot 7e5deaa9-4b31-40f8-8d11-b680318c8792 of volume 0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] snapshot_file for this snap is: volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd2cbd-5058-4f15-b333-66dad810d776]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:21 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e" returned: 0 in 0.961s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-480623084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39bb849-0b34-4b55-b476-c112b7c5d7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:21Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Creating volume b39bb849-0b34-4b55-b476-c112b7c5d7f0 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:21 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098b48a5-3628-48cf-ba68-c97a89582852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:21 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 1073741824 Jul 07 15:12:21 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1e1e12-dc89-4abd-bc38-fbe3806db0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Volume volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e (8f66807f-dc81-4cfc-a437-ee8f746bd77e): created successfully Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1e1e12-dc89-4abd-bc38-fbe3806db0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:21 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 Jul 07 15:12:21 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Flow 'volume_create_manager' (ff604444-c9a8-48cc-b803-faab85fd7463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:21 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5f72d740-3f55-4dfb-acfd-282886b31811 tempest-AttachVolumeNegativeTest-620314878 None] Created volume successfully. Jul 07 15:12:21 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792" returned: 0 in 0.811s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0819d3ff-44b5-4468-86a2-96049f661f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa2ebd8-4109-44ef-96be-d9b9398527b7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:22 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 Jul 07 15:12:22 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:22 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 1073741824" returned: 0 in 0.922s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:22 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 Jul 07 15:12:22 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:22 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70" returned: 0 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:22 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 Jul 07 15:12:22 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:22 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0" returned: 0 in 0.736s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269b198a-1785-41d7-a9fa-9f91d7200cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a975c13-006d-46e7-aad8-221e1442a3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Volume volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 (b39bb849-0b34-4b55-b476-c112b7c5d7f0): created successfully Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a975c13-006d-46e7-aad8-221e1442a3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (8b07c7e8-0786-43d7-977d-da3979d0f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:22 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0ee968e4-a00b-4df2-9e55-c2a0f2bfd731 tempest-VolumesActionsTest-1175323602 None] Created volume successfully. Jul 07 15:12:23 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792" returned: 0 in 0.779s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:23 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792 Jul 07 15:12:23 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-93d06688-97f1-4152-9f44-fb2450d8c9d2 req-9fd2c329-4312-43b7-88c4-3859cf86f47c tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-93d06688-97f1-4152-9f44-fb2450d8c9d2 req-9fd2c329-4312-43b7-88c4-3859cf86f47c tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:23 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[be784d90-c778-47df-bd7f-85975851c7b2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-93d06688-97f1-4152-9f44-fb2450d8c9d2 req-9fd2c329-4312-43b7-88c4-3859cf86f47c tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:23 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 Jul 07 15:12:23 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:24 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70.7e5deaa9-4b31-40f8-8d11-b680318c8792" returned: 0 in 0.707s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-7e5deaa9-4b31-40f8-8d11-b680318c8792" released by "_delete_snapshot" :: held 3.197s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-0819d3ff-44b5-4468-86a2-96049f661f70" released by "delete_snapshot" :: held 3.261s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-b39bb849-0b34-4b55-b476-c112b7c5d7f0-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-b39bb849-0b34-4b55-b476-c112b7c5d7f0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:24 devstack cinder-volume[87257]: WARNING cinder.quota [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-25097431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-25097431, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:12:24 devstack cinder-volume[87257]: WARNING cinder.quota [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-25097431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-25097431, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['14a2ed4c-9bcb-422c-9017-483b1854c4ba', 'd23f7fe1-4ba2-4a92-b7d5-15d8bdac378c', '4395e6ac-1418-4911-bead-0282b46a6d63', '37d96768-f218-43cc-9636-3705f7c1103b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-quobyte-b39bb849-0b34-4b55-b476-c112b7c5d7f0" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-b39bb849-0b34-4b55-b476-c112b7c5d7f0" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c03f3-fe84-426b-ac5c-85b9f5013d86]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:24 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-93d06688-97f1-4152-9f44-fb2450d8c9d2 req-9fd2c329-4312-43b7-88c4-3859cf86f47c tempest-AttachVolumeTestJSON-1298375289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0" returned: 0 in 0.871s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-93d06688-97f1-4152-9f44-fb2450d8c9d2 req-9fd2c329-4312-43b7-88c4-3859cf86f47c tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.899s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-93d06688-97f1-4152-9f44-fb2450d8c9d2 req-9fd2c329-4312-43b7-88c4-3859cf86f47c tempest-AttachVolumeTestJSON-1298375289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-f381410f-e268-4e07-bde5-01c974b019f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f3cd6b3-7954-4e50-8717-3c31c9cf0ed9', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:12:24 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 Jul 07 15:12:24 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['ae841b23-ae4a-421f-9795-078cf041c2dc', 'f01f80a6-2dd1-40e5-963d-c7ae2470ad3b', 'de0bf236-bd34-4d5c-816f-13a50c9e1cdd', '12b81701-9bdd-4d2b-92ec-c23136da9821'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-93d06688-97f1-4152-9f44-fb2450d8c9d2 req-9fd2c329-4312-43b7-88c4-3859cf86f47c tempest-AttachVolumeTestJSON-1298375289 None] attachment_update completed successfully. Jul 07 15:12:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bca09f54-a8f3-4ea8-adf7-df86b700b054 tempest-GroupSnapshotsTest-408179056 None] group_snapshot 2239b382-0acf-49ca-8b79-4553b1f151f1: deleted successfully Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-c7daa54f-81d9-4ee4-8019-00c33af42668 req-e744e448-8170-4090-a41f-81da3c6f2c9a tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-c7daa54f-81d9-4ee4-8019-00c33af42668 req-e744e448-8170-4090-a41f-81da3c6f2c9a tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96096794-6957-4fb8-bfbc-afbe0297a07d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c7daa54f-81d9-4ee4-8019-00c33af42668 req-e744e448-8170-4090-a41f-81da3c6f2c9a tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:25 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e Jul 07 15:12:25 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:25 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0" returned: 0 in 0.870s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:25 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0 Jul 07 15:12:25 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-0819d3ff-44b5-4468-86a2-96049f661f70" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-0819d3ff-44b5-4468-86a2-96049f661f70" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:25 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c7daa54f-81d9-4ee4-8019-00c33af42668 req-e744e448-8170-4090-a41f-81da3c6f2c9a tempest-AttachVolumeNegativeTest-620314878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e" returned: 0 in 0.906s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-c7daa54f-81d9-4ee4-8019-00c33af42668 req-e744e448-8170-4090-a41f-81da3c6f2c9a tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.924s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ad1c3c-5969-46c8-af15-9e6c4acb59b4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-c7daa54f-81d9-4ee4-8019-00c33af42668 req-e744e448-8170-4090-a41f-81da3c6f2c9a tempest-AttachVolumeNegativeTest-620314878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa59ef06-e14b-484c-a514-9c19d6deaa65', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:12:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-c7daa54f-81d9-4ee4-8019-00c33af42668 req-e744e448-8170-4090-a41f-81da3c6f2c9a tempest-AttachVolumeNegativeTest-620314878 None] attachment_update completed successfully. Jul 07 15:12:25 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 Jul 07 15:12:25 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:26 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b39bb849-0b34-4b55-b476-c112b7c5d7f0" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-b39bb849-0b34-4b55-b476-c112b7c5d7f0" released by "delete_volume" :: held 1.672s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Created reservations ['f3d230b2-e702-4f27-b68f-327239a95a1f', '60f081eb-26c1-4dfe-a5f4-5870a58abef0', '1352c4f7-d8ed-4060-bc47-2efcb4f67815', '6964a274-4490-4d2e-bb83-3822fb4e4ccf'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:26 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:26 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:26 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70" returned: 0 in 0.846s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:26 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70 Jul 07 15:12:26 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:26 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Deleted volume successfully. Jul 07 15:12:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-99512dab-1e47-49c9-9c1c-8638122a6e14 tempest-VolumesActionsTest-1694010776 None] Lock "cinder-b39bb849-0b34-4b55-b476-c112b7c5d7f0-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (f27c7bab-7736-408f-bba0-11f1762acb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f67a85-e9e5-4b5b-87bc-ec38fb5fb73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f67a85-e9e5-4b5b-87bc-ec38fb5fb73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227961084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc12722f-90ec-49b6-97b5-f4c26f71d4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:27Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a4d918-ec7d-4f87-88ca-4bd328ac0bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a4d918-ec7d-4f87-88ca-4bd328ac0bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b0c496-a213-4aa8-872d-5114d117430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b0c496-a213-4aa8-872d-5114d117430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc12722f-90ec-49b6-97b5-f4c26f71d4cb', 'volume_name': 'volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a5c256-4ea6-49ed-a0d8-96138be57d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a5c256-4ea6-49ed-a0d8-96138be57d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9d505c-b7de-48b9-9934-6d33a3d20287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Volume cc12722f-90ec-49b6-97b5-f4c26f71d4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb', 'volume_size': 1} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227961084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc12722f-90ec-49b6-97b5-f4c26f71d4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:27Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Creating volume cc12722f-90ec-49b6-97b5-f4c26f71d4cb {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:27 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:27 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb 1073741824 Jul 07 15:12:27 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:27 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0819d3ff-44b5-4468-86a2-96049f661f70" returned: 0 in 0.760s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-0819d3ff-44b5-4468-86a2-96049f661f70" released by "delete_volume" :: held 1.667s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-28369593-d981-4cfe-91c1-1a50c54bb3db" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-28369593-d981-4cfe-91c1-1a50c54bb3db" acquired by "delete_volume" :: waited 0.013s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1503c021-9cca-425e-a1f2-28d24bd5251d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:27 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db Jul 07 15:12:27 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:28 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb 1073741824" returned: 0 in 0.843s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:28 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb Jul 07 15:12:28 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:28 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db" returned: 0 in 0.867s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:28 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db Jul 07 15:12:28 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:28 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9d505c-b7de-48b9-9934-6d33a3d20287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77875973-8978-432e-aaa0-50b1e341319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:28 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Volume volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb (cc12722f-90ec-49b6-97b5-f4c26f71d4cb): created successfully Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77875973-8978-432e-aaa0-50b1e341319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (f27c7bab-7736-408f-bba0-11f1762acb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-431819f3-4be0-40c9-a90b-5164d29bca95 tempest-VolumesActionsTest-1175323602 None] Created volume successfully. Jul 07 15:12:29 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-28369593-d981-4cfe-91c1-1a50c54bb3db" returned: 0 in 0.703s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-28369593-d981-4cfe-91c1-1a50c54bb3db" released by "delete_volume" :: held 1.626s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Created reservations ['c551059a-81d6-4c6a-8339-c3238a457c08'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:29 devstack cinder-volume[87257]: WARNING cinder.quota [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-25097431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-25097431, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Created reservations ['a17755d3-51f1-4c82-9673-61e059c9b206', '5bf3fed6-d37e-47f2-8450-ff77ead610ea', '678a2ae9-ca4d-4e14-bb72-e5d25c9025f7', '9ef65469-3c60-43be-835b-dd4a52554f3a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Created reservations ['1c03b125-82ad-4d2e-9209-21a2e6e37929', 'a5f3437c-546d-4bbc-a410-4376fb8423a3', '27afcbe0-f98c-4e01-b585-069bcd30ee09', '9be19215-d529-4864-8c9c-7222056b6ea2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:29 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:29 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-cc12722f-90ec-49b6-97b5-f4c26f71d4cb-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Lock "cinder-cc12722f-90ec-49b6-97b5-f4c26f71d4cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-quobyte-cc12722f-90ec-49b6-97b5-f4c26f71d4cb" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-cc12722f-90ec-49b6-97b5-f4c26f71d4cb" acquired by "delete_volume" :: waited 0.013s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36adf87-4f7f-4b24-92cc-1a9d2cc31056]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:29 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb Jul 07 15:12:29 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:30 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.756s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:30 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6bf5fd9f-4961-4e5a-93c9-bc25cf6968fe tempest-GroupSnapshotsTest-408179056 None] Delete group completed successfully. Jul 07 15:12:30 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb" returned: 0 in 0.914s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:30 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb Jul 07 15:12:30 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0ec256b2-affe-48f2-88dd-b5694f6e17b6 tempest-GroupSnapshotsTest-408179056 None] Group tempest-GroupSnapshotsTest-Group-379240843: creating Jul 07 15:12:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0ec256b2-affe-48f2-88dd-b5694f6e17b6 tempest-GroupSnapshotsTest-408179056 None] Group tempest-GroupSnapshotsTest-Group-379240843: created successfully Jul 07 15:12:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0ec256b2-affe-48f2-88dd-b5694f6e17b6 tempest-GroupSnapshotsTest-408179056 None] Create group completed successfully. Jul 07 15:12:31 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cc12722f-90ec-49b6-97b5-f4c26f71d4cb" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-cc12722f-90ec-49b6-97b5-f4c26f71d4cb" released by "delete_volume" :: held 1.634s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Created reservations ['dcd12dc1-44ca-4f8e-b1b2-26cc5e614aee', '5b8a4816-15f3-4543-a2f7-0a7b2700d4b4', 'ea620e1e-fe22-4be7-849a-a7c725ff0bbc', '224b3a46-5b4b-4141-83c5-29129a96246a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:31 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:31 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=125,cinder:SELECT=126,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:12:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-fd9ff11f-c338-4f47-8623-266499d1aa53 req-991fddb4-759d-4528-8038-df7872ba9e33 tempest-AttachVolumeNegativeTest-620314878 None] Terminate volume connection completed successfully. Jul 07 15:12:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-fd9ff11f-c338-4f47-8623-266499d1aa53 req-991fddb4-759d-4528-8038-df7872ba9e33 tempest-AttachVolumeNegativeTest-620314878 None] Deleting attachment aa59ef06-e14b-484c-a514-9c19d6deaa65. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:12:32 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.745s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:32 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Deleted volume successfully. Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-49dfe921-6830-40a3-b29f-999eb2318a0d tempest-VolumesActionsTest-1694010776 None] Lock "cinder-cc12722f-90ec-49b6-97b5-f4c26f71d4cb-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=139,cinder:SELECT=126,cinder:INSERT=29,cinder:DELETE=5 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (060dd534-7078-4bd3-babf-9924352dd31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb938ee-a1eb-45e4-9d86-14425dcf8618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb938ee-a1eb-45e4-9d86-14425dcf8618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-6166433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1339c35a-4098-4998-beb0-665338d6d35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:32Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62caac2c-673f-43c8-a292-748073f7dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62caac2c-673f-43c8-a292-748073f7dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc88526-9fe6-4a8d-bffb-d52a22f68b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc88526-9fe6-4a8d-bffb-d52a22f68b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1339c35a-4098-4998-beb0-665338d6d35c', 'volume_name': 'volume-1339c35a-4098-4998-beb0-665338d6d35c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a96aa8-015c-4a4d-bd7b-6899af6d2137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a96aa8-015c-4a4d-bd7b-6899af6d2137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844758e4-b995-426d-9dcc-ea83215a91ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Volume 1339c35a-4098-4998-beb0-665338d6d35c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1339c35a-4098-4998-beb0-665338d6d35c', 'volume_size': 1} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-6166433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1339c35a-4098-4998-beb0-665338d6d35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:32Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Creating volume 1339c35a-4098-4998-beb0-665338d6d35c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:32 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:32 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c 1073741824 Jul 07 15:12:32 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (7053381e-1051-4259-84f8-654a8d2d6fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae82b3f8-8e18-4f6c-9529-cc871a3151fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae82b3f8-8e18-4f6c-9529-cc871a3151fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-347565412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40a3eea6-a616-4180-a593-3acdc3b0c19b,host='devstack@QuobyteHD#QuobyteHD',id=889298e3-3a3f-4803-b8bc-e20a32154910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:33Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcac8eb8-2f5c-4609-8193-71ebd6ef15ee),volume_type_id=fcac8eb8-2f5c-4609-8193-71ebd6ef15ee)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b1a753-4abf-48eb-83a9-9f8416f40ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b1a753-4abf-48eb-83a9-9f8416f40ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c474774-ce92-485a-8e3f-ee4f96cdb932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c474774-ce92-485a-8e3f-ee4f96cdb932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889298e3-3a3f-4803-b8bc-e20a32154910', 'volume_name': 'volume-889298e3-3a3f-4803-b8bc-e20a32154910', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8569b4-8209-4440-8b20-6ebb373941e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8569b4-8209-4440-8b20-6ebb373941e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bad9560-73cf-4491-b73f-225d1fd9fb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Volume 889298e3-3a3f-4803-b8bc-e20a32154910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889298e3-3a3f-4803-b8bc-e20a32154910', 'volume_size': 1} Jul 07 15:12:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:33 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c 1073741824" returned: 0 in 0.963s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:33 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c Jul 07 15:12:33 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:34 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c" returned: 0 in 0.697s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=40a3eea6-a616-4180-a593-3acdc3b0c19b,created_at=2026-07-07T13:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-347565412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40a3eea6-a616-4180-a593-3acdc3b0c19b,host='devstack@QuobyteHD#QuobyteHD',id=889298e3-3a3f-4803-b8bc-e20a32154910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fe8b6162cd4d7cbf968dfe9c02fed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:33Z,use_quota=True,user_id='c0086d3578484bfbb413f19a7c6c1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcac8eb8-2f5c-4609-8193-71ebd6ef15ee),volume_type_id=fcac8eb8-2f5c-4609-8193-71ebd6ef15ee)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Creating volume 889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:34 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:34 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 1073741824 Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844758e4-b995-426d-9dcc-ea83215a91ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1339c35a-4098-4998-beb0-665338d6d35c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:34 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a53a046-b598-42c3-86dc-8c22a342431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:34 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Volume volume-1339c35a-4098-4998-beb0-665338d6d35c (1339c35a-4098-4998-beb0-665338d6d35c): created successfully Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a53a046-b598-42c3-86dc-8c22a342431b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (060dd534-7078-4bd3-babf-9924352dd31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d2018ea0-11d0-4f33-9542-b4eabed0924c tempest-VolumesActionsTest-1175323602 None] Created volume successfully. Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-1339c35a-4098-4998-beb0-665338d6d35c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Lock "cinder-1339c35a-4098-4998-beb0-665338d6d35c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Acquiring lock "cinder-quobyte-1339c35a-4098-4998-beb0-665338d6d35c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-1339c35a-4098-4998-beb0-665338d6d35c" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9650c17-b69e-4e20-aa20-99d06d18e69d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:34 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c Jul 07 15:12:34 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:35 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 1073741824" returned: 0 in 0.893s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:35 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 Jul 07 15:12:35 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:35 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c" returned: 0 in 0.908s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:35 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c Jul 07 15:12:35 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:35 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910" returned: 0 in 0.901s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bad9560-73cf-4491-b73f-225d1fd9fb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889298e3-3a3f-4803-b8bc-e20a32154910', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037c9d29-23a7-479c-8d2b-c834bec15cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:36 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Volume volume-889298e3-3a3f-4803-b8bc-e20a32154910 (889298e3-3a3f-4803-b8bc-e20a32154910): created successfully Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037c9d29-23a7-479c-8d2b-c834bec15cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Flow 'volume_create_manager' (7053381e-1051-4259-84f8-654a8d2d6fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:36 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2fbbbda6-6e2b-40ac-a310-d78cc2366ce0 tempest-GroupSnapshotsTest-408179056 None] Created volume successfully. Jul 07 15:12:36 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1339c35a-4098-4998-beb0-665338d6d35c" returned: 0 in 0.910s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Lock "cinder-quobyte-1339c35a-4098-4998-beb0-665338d6d35c" released by "delete_volume" :: held 1.877s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Created reservations ['19562056-7bb9-46f8-9594-36aa5f2a8a05', 'cc02028c-b69d-4030-8985-cff54a2b31e7', 'a35db8b9-28ec-4514-a4d9-b926ad86d490', '505fee7a-53ea-42d8-889e-97df11448541'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:36 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] GroupSnapshot da0647bb-a4b7-454d-b7f7-6e4019bbdc9e: creating. Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Group snapshot da0647bb-a4b7-454d-b7f7-6e4019bbdc9e: creating. {{(pid=87257) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Creating offline snapshot 0015fd16-c33f-442f-b058-bdbb6eb8f031 of volume 889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:12:36 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:36 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af840313-eaad-49a8-8b18-722fdba11b50]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:37 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 Jul 07 15:12:37 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (5cf02391-9bbe-4f07-b2f1-5e5f58512da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f467407b-953b-4ea5-9843-4dc007da1427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f467407b-953b-4ea5-9843-4dc007da1427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1264244269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40a9915-839d-448e-ac43-2739e990ba90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:37Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a31bc5-b83a-4986-ab42-362f8971efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a31bc5-b83a-4986-ab42-362f8971efe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edee7bdb-223c-46c2-b76d-bfff07a66c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edee7bdb-223c-46c2-b76d-bfff07a66c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40a9915-839d-448e-ac43-2739e990ba90', 'volume_name': 'volume-d40a9915-839d-448e-ac43-2739e990ba90', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6afe6ba-4515-4fb8-a35c-880a28c17383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6afe6ba-4515-4fb8-a35c-880a28c17383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3443a7e4-2110-4d6f-ab80-13a918741a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:37 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Volume d40a9915-839d-448e-ac43-2739e990ba90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40a9915-839d-448e-ac43-2739e990ba90', 'volume_size': 1} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:37 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.980s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Deleted volume successfully. Jul 07 15:12:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f54cf92-1c01-4c76-bcfe-5bb9b840994f tempest-VolumesActionsTest-1694010776 None] Lock "cinder-1339c35a-4098-4998-beb0-665338d6d35c-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:38 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910" returned: 0 in 1.115s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:38 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 1G Jul 07 15:12:38 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:38 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 1G" returned: 0 in 0.969s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889298e3-3a3f-4803-b8bc-e20a32154910 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:39 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889298e3-3a3f-4803-b8bc-e20a32154910 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 Jul 07 15:12:39 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:39 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889298e3-3a3f-4803-b8bc-e20a32154910 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031" returned: 0 in 0.729s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:39 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:12:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:39 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 Jul 07 15:12:39 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:40 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031" returned: 0 in 0.668s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:40 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.info Jul 07 15:12:40 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:41 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.info" returned: 0 in 0.728s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:41 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:41 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.info Jul 07 15:12:41 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:41 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.info" returned: 0 in 0.709s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.031s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.216s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1264244269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40a9915-839d-448e-ac43-2739e990ba90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa90b9c68f074b0e8effbe81ce2dfbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:12:37Z,use_quota=True,user_id='b55870c6f049477d9090e0765bb91e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Creating volume d40a9915-839d-448e-ac43-2739e990ba90 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:12:41 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:12:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:41 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 1073741824 Jul 07 15:12:41 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:42 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2d93c869-d2c1-43c5-97f2-907eb25c718b tempest-GroupSnapshotsTest-408179056 None] group_snapshot da0647bb-a4b7-454d-b7f7-6e4019bbdc9e: created successfully Jul 07 15:12:42 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] group_snapshot da0647bb-a4b7-454d-b7f7-6e4019bbdc9e: deleting Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] group_snapshot da0647bb-a4b7-454d-b7f7-6e4019bbdc9e: deleting {{(pid=87257) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-889298e3-3a3f-4803-b8bc-e20a32154910" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-889298e3-3a3f-4803-b8bc-e20a32154910" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-0015fd16-c33f-442f-b058-bdbb6eb8f031" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-0015fd16-c33f-442f-b058-bdbb6eb8f031" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Deleting offline snapshot 0015fd16-c33f-442f-b058-bdbb6eb8f031 of volume 889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] snapshot_file for this snap is: volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4083b1d1-57c8-4354-90a1-e2352824233e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:43 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 Jul 07 15:12:43 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:43 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 1073741824" returned: 0 in 1.558s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:43 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 Jul 07 15:12:43 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:44 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90" returned: 0 in 0.791s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3443a7e4-2110-4d6f-ab80-13a918741a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40a9915-839d-448e-ac43-2739e990ba90', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731a2662-7fe4-4ced-a1ea-35297b191628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:12:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Volume volume-d40a9915-839d-448e-ac43-2739e990ba90 (d40a9915-839d-448e-ac43-2739e990ba90): created successfully Jul 07 15:12:44 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731a2662-7fe4-4ced-a1ea-35297b191628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Flow 'volume_create_manager' (5cf02391-9bbe-4f07-b2f1-5e5f58512da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031" returned: 0 in 1.404s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-889298e3-3a3f-4803-b8bc-e20a32154910(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:12:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a59df1b3-5501-46a5-9b18-ea32f48d2b7f tempest-VolumesActionsTest-1175323602 None] Created volume successfully. Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc4fbb9-ad9c-4a49-9dbe-61bcd3aa5d28]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:44 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 Jul 07 15:12:44 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:45 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910" returned: 0 in 1.249s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:45 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 Jul 07 15:12:45 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "cinder-d40a9915-839d-448e-ac43-2739e990ba90-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Lock "cinder-d40a9915-839d-448e-ac43-2739e990ba90-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "cinder-quobyte-d40a9915-839d-448e-ac43-2739e990ba90" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Lock "cinder-quobyte-d40a9915-839d-448e-ac43-2739e990ba90" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d74ffb-0d11-4a8b-abfa-d42cbc2c67e1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:46 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 Jul 07 15:12:46 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:46 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031" returned: 0 in 1.120s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:46 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031 Jul 07 15:12:46 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:47 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90" returned: 0 in 1.113s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:47 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90 Jul 07 15:12:47 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:47 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910.0015fd16-c33f-442f-b058-bdbb6eb8f031" returned: 0 in 0.755s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-0015fd16-c33f-442f-b058-bdbb6eb8f031" released by "_delete_snapshot" :: held 4.722s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-889298e3-3a3f-4803-b8bc-e20a32154910" released by "delete_snapshot" :: held 4.777s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:47 devstack cinder-volume[87257]: WARNING cinder.quota [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-390661830 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-390661830, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:12:47 devstack cinder-volume[87257]: WARNING cinder.quota [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-390661830 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-390661830, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:12:47 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] Created reservations ['623519ea-53de-4c58-b245-f2df2a559d65', '476699cf-1731-41cf-8cee-be44e431176d', '6034c748-9cb3-44b8-bce2-1e097c11fa5d', '136b142c-9626-4264-b084-73bacd42719c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-077de8dd-c8ed-4317-976d-5f4a2c9f0f40 tempest-GroupSnapshotsTest-408179056 None] group_snapshot da0647bb-a4b7-454d-b7f7-6e4019bbdc9e: deleted successfully Jul 07 15:12:48 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d40a9915-839d-448e-ac43-2739e990ba90" returned: 0 in 0.780s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Lock "cinder-quobyte-d40a9915-839d-448e-ac43-2739e990ba90" released by "delete_volume" :: held 1.962s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Created reservations ['f8e86112-803b-4f40-a6cd-1dbe4bc9db91', '4a4a4e3d-1970-474d-91a5-46bfb6bd8703', '6707ad5f-b9ee-416e-8b29-fc66ce7a4d3d', 'e3544129-96af-4468-8574-b2badf0d783b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:48 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:48 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "cinder-quobyte-889298e3-3a3f-4803-b8bc-e20a32154910" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-889298e3-3a3f-4803-b8bc-e20a32154910" acquired by "delete_volume" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5574db-6e8a-4176-9ffa-602a697d665c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:12:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:49 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 Jul 07 15:12:49 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:49 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.883s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:49 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Deleted volume successfully. Jul 07 15:12:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e02f53a8-0060-4ffb-9c9c-fe491c853b07 tempest-VolumesActionsTest-1175323602 None] Lock "cinder-d40a9915-839d-448e-ac43-2739e990ba90-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:49 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910" returned: 0 in 1.013s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:49 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910 Jul 07 15:12:49 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:50 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889298e3-3a3f-4803-b8bc-e20a32154910" returned: 0 in 0.761s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Lock "cinder-quobyte-889298e3-3a3f-4803-b8bc-e20a32154910" released by "delete_volume" :: held 1.863s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Created reservations ['3edb27b7-2de5-44e5-84a4-18886f638b23'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:50 devstack cinder-volume[87257]: WARNING cinder.quota [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-390661830 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-390661830, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Created reservations ['0fb51ef0-058f-48cd-82fb-31405fbd28b6', 'cc19ab6e-8f53-4b0a-bb87-fc34f3c4d1e4', 'c9d2c7ac-abf6-4ea3-8ac4-bdd9fc973e0b', 'aa1fd5c0-3c62-4068-9367-adcf5eaaf211'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:12:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:12:50 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:12:50 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:12:51 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 07 15:12:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.941s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:12:51 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:12:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6cb77a57-8c6c-497a-866a-4cfc9d8305fe tempest-GroupSnapshotsTest-408179056 None] Delete group completed successfully. Jul 07 15:12:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6c97b233-0c67-4563-8c6c-999a8952a19a tempest-GroupsV314Test-968090220 None] Group tempest-GroupsV314Test-Group-2099747135: creating Jul 07 15:12:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6c97b233-0c67-4563-8c6c-999a8952a19a tempest-GroupsV314Test-968090220 None] Group tempest-GroupsV314Test-Group-2099747135: created successfully Jul 07 15:12:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6c97b233-0c67-4563-8c6c-999a8952a19a tempest-GroupsV314Test-968090220 None] Create group completed successfully. Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:00 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:00 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:00 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.743s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:13:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Flow 'volume_create_manager' (3e4a74dc-7d69-424b-81cc-12a216d2d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf45d09-6f63-45ed-bc74-840f4c4b6cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf45d09-6f63-45ed-bc74-840f4c4b6cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271249911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5f9c37f-5221-4dff-ada2-3036c672ad58,host='devstack@QuobyteHD#QuobyteHD',id=234ec1da-1c67-44ec-9271-95120e4f9b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d5271172a747c7bbf504f35ecfa2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:01Z,use_quota=True,user_id='6d2e1ad542cf41e5bcf6fe21aaa2fe53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19924e03-208f-4c66-99c4-cc1eec9365bb),volume_type_id=19924e03-208f-4c66-99c4-cc1eec9365bb)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53011342-51ed-4063-8971-1949617f45d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53011342-51ed-4063-8971-1949617f45d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff45064-296c-4295-b504-e6363c17bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff45064-296c-4295-b504-e6363c17bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234ec1da-1c67-44ec-9271-95120e4f9b16', 'volume_name': 'volume-234ec1da-1c67-44ec-9271-95120e4f9b16', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e70ab-7b27-46bb-b7a1-5a7ecdb487be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e70ab-7b27-46bb-b7a1-5a7ecdb487be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df47dcf-cf19-46e0-ae26-d17675e4dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:01 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Volume 234ec1da-1c67-44ec-9271-95120e4f9b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234ec1da-1c67-44ec-9271-95120e4f9b16', 'volume_size': 1} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5f9c37f-5221-4dff-ada2-3036c672ad58,created_at=2026-07-07T13:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271249911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5f9c37f-5221-4dff-ada2-3036c672ad58,host='devstack@QuobyteHD#QuobyteHD',id=234ec1da-1c67-44ec-9271-95120e4f9b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d5271172a747c7bbf504f35ecfa2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:01Z,use_quota=True,user_id='6d2e1ad542cf41e5bcf6fe21aaa2fe53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19924e03-208f-4c66-99c4-cc1eec9365bb),volume_type_id=19924e03-208f-4c66-99c4-cc1eec9365bb)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Creating volume 234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:13:01 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:13:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:01 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 1073741824 Jul 07 15:13:01 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:02 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 1073741824" returned: 0 in 0.973s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:02 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 Jul 07 15:13:02 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:03 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16" returned: 0 in 0.951s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:13:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df47dcf-cf19-46e0-ae26-d17675e4dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234ec1da-1c67-44ec-9271-95120e4f9b16', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929b624a-759a-4f64-96db-49ff01e32e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:03 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Volume volume-234ec1da-1c67-44ec-9271-95120e4f9b16 (234ec1da-1c67-44ec-9271-95120e4f9b16): created successfully Jul 07 15:13:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929b624a-759a-4f64-96db-49ff01e32e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Flow 'volume_create_manager' (3e4a74dc-7d69-424b-81cc-12a216d2d55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1a761727-97db-426c-8a56-f2907354795e tempest-GroupsV314Test-968090220 None] Created volume successfully. Jul 07 15:13:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:05 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Cloning volume 234ec1da-1c67-44ec-9271-95120e4f9b16 to volume d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 Jul 07 15:13:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Creating offline snapshot 362bf6a3-aceb-47b3-a1d5-b22a430b270c of volume 234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:13:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c1be1-ffce-4b2d-ab4b-c6588fc6f9c5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:05 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 Jul 07 15:13:05 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:06 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16" returned: 0 in 1.576s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:07 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c 1G Jul 07 15:13:07 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Flow 'volume_create_manager' (c99d20ee-1204-46a6-a676-b1ab214b9023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8a708-3bd9-43f6-b2e9-13060ab0e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8a708-3bd9-43f6-b2e9-13060ab0e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1433681023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c3dab2-d798-423d-821c-8c551c7555fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82119eb966b443d9f0bdfb5b4580ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:08Z,use_quota=True,user_id='5e0d8b2f2f1b4ec1a34bf0678545fbed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74f46e0-e00e-4565-81ec-678272445af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74f46e0-e00e-4565-81ec-678272445af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918821e9-417c-478d-a0fe-01602e6f5439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918821e9-417c-478d-a0fe-01602e6f5439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c3dab2-d798-423d-821c-8c551c7555fd', 'volume_name': 'volume-c2c3dab2-d798-423d-821c-8c551c7555fd', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77261ae8-fbac-492c-a792-2780254567b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77261ae8-fbac-492c-a792-2780254567b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483c0a9b-ad73-4516-98fb-9a233b3a9798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:07 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Volume c2c3dab2-d798-423d-821c-8c551c7555fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c3dab2-d798-423d-821c-8c551c7555fd', 'volume_size': 1} Jul 07 15:13:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:08 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-a850474a-09d4-4200-98d2-307ccb63e999 req-4c307896-b766-46ca-8d62-52ba0d3efecd tempest-AttachVolumeTestJSON-1298375289 None] Terminate volume connection completed successfully. Jul 07 15:13:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-a850474a-09d4-4200-98d2-307ccb63e999 req-4c307896-b766-46ca-8d62-52ba0d3efecd tempest-AttachVolumeTestJSON-1298375289 None] Deleting attachment 3f3cd6b3-7954-4e50-8717-3c31c9cf0ed9. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:13:08 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c 1G" returned: 0 in 1.243s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234ec1da-1c67-44ec-9271-95120e4f9b16 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:08 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234ec1da-1c67-44ec-9271-95120e4f9b16 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c Jul 07 15:13:08 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:09 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234ec1da-1c67-44ec-9271-95120e4f9b16 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c" returned: 0 in 0.761s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:09 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:13:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:09 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c Jul 07 15:13:09 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:09 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c" returned: 0 in 0.727s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:09 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.info Jul 07 15:13:09 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:10 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.info" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:10 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:13:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:10 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.info Jul 07 15:13:10 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:11 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.info" returned: 0 in 0.711s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Acquiring lock "cinder-quobyte-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] snapshot: 362bf6a3-aceb-47b3-a1d5-b22a430b270c, volume: d15ecb78-3870-4297-9d0e-4d23a4ac7bc7, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e4a07-0cd3-43ab-9fec-c705bbf79469]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:11 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c Jul 07 15:13:11 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:12 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c" returned: 0 in 0.941s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234ec1da-1c67-44ec-9271-95120e4f9b16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:13:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:13:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:13:12 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b7cc19-9b92-4074-8aee-ab1c56a25f0e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:12 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 Jul 07 15:13:12 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:13 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16" returned: 0 in 0.809s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:13 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:13:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:13 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 Jul 07 15:13:13 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:18 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" returned: 0 in 5.639s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e343f2e4-ed38-4726-8441-923a5d0fba5f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:18 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 Jul 07 15:13:18 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:19 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16" returned: 0 in 0.892s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:19 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:13:19 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Converted 1024.00 MB image at 181.55 MB/s Jul 07 15:13:19 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:13:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:19 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 Jul 07 15:13:19 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:19 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:DELETE=6,cinder:UPDATE=58,cinder:SELECT=43,cinder:INSERT=10 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:13:19 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=52,cinder:UPDATE=40,cinder:INSERT=14,cinder:DELETE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:13:20 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" returned: 0 in 0.705s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" released by "_copy_volume_from_snapshot" :: held 9.103s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Acquiring lock "cinder-quobyte-362bf6a3-aceb-47b3-a1d5-b22a430b270c" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-362bf6a3-aceb-47b3-a1d5-b22a430b270c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Deleting offline snapshot 362bf6a3-aceb-47b3-a1d5-b22a430b270c of volume 234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] snapshot_file for this snap is: volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732b594-7025-453d-a58a-c1f57316d703]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:20 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c Jul 07 15:13:20 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:21 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c" returned: 0 in 0.785s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234ec1da-1c67-44ec-9271-95120e4f9b16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:13:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d897beb-d351-45a0-84b7-1af20acd60ab]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:21 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 Jul 07 15:13:21 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:22 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16" returned: 0 in 1.123s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:22 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c Jul 07 15:13:22 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:23 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c" returned: 0 in 0.875s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:23 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c Jul 07 15:13:23 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:23 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16.362bf6a3-aceb-47b3-a1d5-b22a430b270c" returned: 0 in 0.747s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-362bf6a3-aceb-47b3-a1d5-b22a430b270c" released by "_delete_snapshot" :: held 3.632s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.728s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.150s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1433681023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c3dab2-d798-423d-821c-8c551c7555fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a82119eb966b443d9f0bdfb5b4580ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:08Z,use_quota=True,user_id='5e0d8b2f2f1b4ec1a34bf0678545fbed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Creating volume c2c3dab2-d798-423d-821c-8c551c7555fd {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:13:24 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:13:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:24 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd 1073741824 Jul 07 15:13:24 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6eeb9b53-2f35-4a81-98c1-ed3b3eb5e1cd tempest-GroupsV314Test-968090220 None] Create group from source-group-d5f9c37f-5221-4dff-ada2-3036c672ad58 completed successfully. Jul 07 15:13:25 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd 1073741824" returned: 0 in 1.130s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:25 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd Jul 07 15:13:25 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Acquiring lock "cinder-quobyte-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89663a2-de94-412a-9f0b-1bd1a117119f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:25 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 Jul 07 15:13:25 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:25 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd" returned: 0 in 0.690s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483c0a9b-ad73-4516-98fb-9a233b3a9798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c3dab2-d798-423d-821c-8c551c7555fd', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fdff64-e04d-4b2c-874e-8b1f411de554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Volume volume-c2c3dab2-d798-423d-821c-8c551c7555fd (c2c3dab2-d798-423d-821c-8c551c7555fd): created successfully Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fdff64-e04d-4b2c-874e-8b1f411de554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Flow 'volume_create_manager' (c99d20ee-1204-46a6-a676-b1ab214b9023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-30e3ddf6-e659-41a3-b4cd-e5a52d9f2b89 tempest-VolumesMetadataTest-1343318058 None] Created volume successfully. Jul 07 15:13:26 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" returned: 0 in 0.798s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:26 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7 Jul 07 15:13:26 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:26 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:13:26 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Flow 'volume_create_manager' (9a9c7a75-967c-442a-872a-5319e9eedfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1dcf80-0548-4b8a-9256-2a58a3f7890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" returned: 0 in 0.853s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-d15ecb78-3870-4297-9d0e-4d23a4ac7bc7" released by "delete_volume" :: held 1.711s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1dcf80-0548-4b8a-9256-2a58a3f7890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1944026182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7614f4-859c-4929-8d6b-8c5be17151c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207e5e9dc17247ef8065a84d7c6bdbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:27Z,use_quota=True,user_id='29205121708c4a9b983077c6f2f25699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a29ae5-bd8a-4338-8a77-51bef94809e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a29ae5-bd8a-4338-8a77-51bef94809e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa5603a-c339-4c48-bbae-c2d408f99fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa5603a-c339-4c48-bbae-c2d408f99fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7614f4-859c-4929-8d6b-8c5be17151c4', 'volume_name': 'volume-1b7614f4-859c-4929-8d6b-8c5be17151c4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8357e6-7cf6-4e42-9b28-361917dce5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8357e6-7cf6-4e42-9b28-361917dce5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0151d7a2-d891-4d6d-87c1-19644bb8a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Volume 1b7614f4-859c-4929-8d6b-8c5be17151c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7614f4-859c-4929-8d6b-8c5be17151c4', 'volume_size': 1} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1944026182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7614f4-859c-4929-8d6b-8c5be17151c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207e5e9dc17247ef8065a84d7c6bdbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:27Z,use_quota=True,user_id='29205121708c4a9b983077c6f2f25699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Creating volume 1b7614f4-859c-4929-8d6b-8c5be17151c4 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:13:27 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:27 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 1073741824 Jul 07 15:13:27 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Created reservations ['987aeac4-c655-46e0-a6ec-1e0ee52707dd'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:27 devstack cinder-volume[87257]: WARNING cinder.quota [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-265938749 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-265938749, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:13:27 devstack cinder-volume[87257]: WARNING cinder.quota [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-265938749 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-265938749, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Created reservations ['3ba3a428-1b7e-476d-9f72-a3bb107c8a26', 'd589b5ec-4f6e-4b0c-ba69-0c19b3a5a39a', 'f6480df3-4c49-4c6f-be97-351501a546ce', '8872852d-49e7-402d-af5b-f13bcd452533'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Acquiring lock "cinder-c2c3dab2-d798-423d-821c-8c551c7555fd-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Lock "cinder-c2c3dab2-d798-423d-821c-8c551c7555fd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Acquiring lock "cinder-quobyte-c2c3dab2-d798-423d-821c-8c551c7555fd" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Lock "cinder-quobyte-c2c3dab2-d798-423d-821c-8c551c7555fd" acquired by "delete_volume" :: waited 0.041s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:27 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:27 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9294a8d-0ed0-44b4-ad06-73ede9aade4f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:27 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd Jul 07 15:13:27 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:28 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 1073741824" returned: 0 in 1.033s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:28 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 Jul 07 15:13:28 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Acquiring lock "cinder-quobyte-234ec1da-1c67-44ec-9271-95120e4f9b16" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-234ec1da-1c67-44ec-9271-95120e4f9b16" acquired by "delete_volume" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0f9256-5a61-47e6-93e7-864a47c7e619]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:28 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.001s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-89caca32-2486-414a-bc2f-de2eb85b35e2 tempest-GroupsV314Test-968090220 None] Delete group completed successfully. Jul 07 15:13:28 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 Jul 07 15:13:28 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:28 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd" returned: 0 in 1.160s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:28 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd Jul 07 15:13:28 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:29 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4" returned: 0 in 0.960s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0151d7a2-d891-4d6d-87c1-19644bb8a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7614f4-859c-4929-8d6b-8c5be17151c4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3595a1-f74c-441e-89e3-a95d317e613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Volume volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 (1b7614f4-859c-4929-8d6b-8c5be17151c4): created successfully Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3595a1-f74c-441e-89e3-a95d317e613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Flow 'volume_create_manager' (9a9c7a75-967c-442a-872a-5319e9eedfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-25394fea-e56e-4047-96aa-951901fc9a7e tempest-AttachVolumeNegativeTest-620314878 None] Created volume successfully. Jul 07 15:13:29 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c2c3dab2-d798-423d-821c-8c551c7555fd" returned: 0 in 0.711s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Lock "cinder-quobyte-c2c3dab2-d798-423d-821c-8c551c7555fd" released by "delete_volume" :: held 1.925s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:29 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16" returned: 0 in 0.995s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:29 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16 Jul 07 15:13:29 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Created reservations ['6e74bfb2-701e-4bc6-aeab-dfc496f657cf', '0bf7ebbd-3082-4c8a-a9bd-3804eb83a534', '4eb7b102-8d1b-4078-a0af-6e524c6b8299', 'dd6846d6-dc4b-46b7-b283-f85134b42e45'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:29 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:29 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:30 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-234ec1da-1c67-44ec-9271-95120e4f9b16" returned: 0 in 0.885s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Lock "cinder-quobyte-234ec1da-1c67-44ec-9271-95120e4f9b16" released by "delete_volume" :: held 1.990s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Created reservations ['8380de55-beb9-4434-a106-5d41098da374'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:30 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Created reservations ['d3187b07-177b-4129-9fe1-1c732a60068d', 'ff22618e-c823-470f-93a0-14183a0255c7', '8f76109a-5372-4bd2-aa14-5d1ba2fb58c2', '69f62aa0-b5cf-4956-ba48-f1ce3ab8546f'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.995s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Deleted volume successfully. Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e8375adb-5e34-4d72-b7e7-ff024ab13e70 tempest-VolumesMetadataTest-1343318058 None] Lock "cinder-c2c3dab2-d798-423d-821c-8c551c7555fd-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:30 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:30 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:31 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.034s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:31 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1798153e-6660-4408-8be7-93872e233371 tempest-GroupsV314Test-968090220 None] Delete group completed successfully. Jul 07 15:13:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-ee3fe170-d2be-4e8a-a225-ea9d1e64937a req-0680a009-b0d8-4914-acd8-f9cba8d6619d tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-ee3fe170-d2be-4e8a-a225-ea9d1e64937a req-0680a009-b0d8-4914-acd8-f9cba8d6619d tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[720d4760-0597-4b47-9f01-c3faf81a6c9a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-ee3fe170-d2be-4e8a-a225-ea9d1e64937a req-0680a009-b0d8-4914-acd8-f9cba8d6619d tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:34 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 Jul 07 15:13:34 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:34 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-ee3fe170-d2be-4e8a-a225-ea9d1e64937a req-0680a009-b0d8-4914-acd8-f9cba8d6619d tempest-AttachVolumeNegativeTest-620314878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4" returned: 0 in 1.031s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-ee3fe170-d2be-4e8a-a225-ea9d1e64937a req-0680a009-b0d8-4914-acd8-f9cba8d6619d tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-ee3fe170-d2be-4e8a-a225-ea9d1e64937a req-0680a009-b0d8-4914-acd8-f9cba8d6619d tempest-AttachVolumeNegativeTest-620314878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-1b7614f4-859c-4929-8d6b-8c5be17151c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5ad243e-fe9f-4f27-9e13-f86087e4084d', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:13:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-ee3fe170-d2be-4e8a-a225-ea9d1e64937a req-0680a009-b0d8-4914-acd8-f9cba8d6619d tempest-AttachVolumeNegativeTest-620314878 None] attachment_update completed successfully. Jul 07 15:13:35 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:13:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Flow 'volume_create_manager' (2568b54a-3509-4304-b24a-23f3025c4d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53186a6-74b5-458c-910c-731b9fec38c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53186a6-74b5-458c-910c-731b9fec38c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1907178191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b873ae2a-2569-40d3-a106-a3473d857de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c42e99a539473e89c488a36c3879ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:36Z,use_quota=True,user_id='b78fc3c3e7794dfeb67e297ab64d2899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c5a910-deb1-43fb-ac94-3f668642a3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c5a910-deb1-43fb-ac94-3f668642a3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d73a754-14f7-4a35-8f4a-3ea2db8c85fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d73a754-14f7-4a35-8f4a-3ea2db8c85fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b873ae2a-2569-40d3-a106-a3473d857de4', 'volume_name': 'volume-b873ae2a-2569-40d3-a106-a3473d857de4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96fc45d-10ad-4718-aa5e-464136ba7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96fc45d-10ad-4718-aa5e-464136ba7d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9d605e-8060-476f-b935-5fef544fff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:36 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Volume b873ae2a-2569-40d3-a106-a3473d857de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b873ae2a-2569-40d3-a106-a3473d857de4', 'volume_size': 1} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1907178191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b873ae2a-2569-40d3-a106-a3473d857de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c42e99a539473e89c488a36c3879ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:36Z,use_quota=True,user_id='b78fc3c3e7794dfeb67e297ab64d2899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Creating volume b873ae2a-2569-40d3-a106-a3473d857de4 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:13:36 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:13:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:36 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 1073741824 Jul 07 15:13:36 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:37 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 1073741824" returned: 0 in 0.941s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:37 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 Jul 07 15:13:37 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:37 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4" returned: 0 in 0.652s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9d605e-8060-476f-b935-5fef544fff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b873ae2a-2569-40d3-a106-a3473d857de4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da50b7ed-c6a3-4220-974d-32b1a5e752d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:37 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Volume volume-b873ae2a-2569-40d3-a106-a3473d857de4 (b873ae2a-2569-40d3-a106-a3473d857de4): created successfully Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da50b7ed-c6a3-4220-974d-32b1a5e752d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Flow 'volume_create_manager' (2568b54a-3509-4304-b24a-23f3025c4d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-829afe81-88c6-4c32-8e0d-24d3f6c614b4 tempest-VolumesTransfersTest-628841717 None] Created volume successfully. Jul 07 15:13:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-cb9a426f-c0ca-47c1-8c63-255d5c40f98b tempest-VolumesTransfersTest-1009522794 None] Transfer volume completed successfully. Jul 07 15:13:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Acquiring lock "cinder-b873ae2a-2569-40d3-a106-a3473d857de4-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-b873ae2a-2569-40d3-a106-a3473d857de4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Acquiring lock "cinder-quobyte-b873ae2a-2569-40d3-a106-a3473d857de4" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-quobyte-b873ae2a-2569-40d3-a106-a3473d857de4" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7097d-72f6-4dbc-af84-1e7dc3ff1240]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:40 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 Jul 07 15:13:40 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:41 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4" returned: 0 in 0.859s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:41 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4 Jul 07 15:13:41 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:41 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b873ae2a-2569-40d3-a106-a3473d857de4" returned: 0 in 0.707s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-quobyte-b873ae2a-2569-40d3-a106-a3473d857de4" released by "delete_volume" :: held 1.617s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Created reservations ['ac29dabb-381f-4343-9560-f5227eb22c46', '009c71a1-fafa-4cec-87c8-322d83e1a1e0', '5c8ad39b-4a93-42e2-a87d-63200b0aaf51', '16009bbb-b667-458e-93d2-bd41a2f8ac1d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-4457b00b-f7f8-4586-b3cd-aa508e84416f req-ebea0413-e514-4794-b28f-6ff25e1d40fd tempest-AttachVolumeNegativeTest-620314878 None] Terminate volume connection completed successfully. Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-4457b00b-f7f8-4586-b3cd-aa508e84416f req-ebea0413-e514-4794-b28f-6ff25e1d40fd tempest-AttachVolumeNegativeTest-620314878 None] Deleting attachment a5ad243e-fe9f-4f27-9e13-f86087e4084d. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:42 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:42 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:43 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.178s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Deleted volume successfully. Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f3954538-f17d-4025-bc5d-6b04e95fc615 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-b873ae2a-2569-40d3-a106-a3473d857de4-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Flow 'volume_create_manager' (067c68e4-ec9f-4e47-bb5b-a5bf2725020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d463bfd-7f52-4d7a-9f0e-620d618b38ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d463bfd-7f52-4d7a-9f0e-620d618b38ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2117069015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8207e390-e800-4d1f-b63c-f3ca5f15dc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c42e99a539473e89c488a36c3879ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:43Z,use_quota=True,user_id='b78fc3c3e7794dfeb67e297ab64d2899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1311b077-ad62-4083-960f-eb267f819b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1311b077-ad62-4083-960f-eb267f819b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc1fea1-945b-42c6-a5b0-5870a94a2aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc1fea1-945b-42c6-a5b0-5870a94a2aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8207e390-e800-4d1f-b63c-f3ca5f15dc32', 'volume_name': 'volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c984039-7033-4ac8-8e01-67848d5a6036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c984039-7033-4ac8-8e01-67848d5a6036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0e6165-70ce-4673-9334-0b135dc1a59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Volume 8207e390-e800-4d1f-b63c-f3ca5f15dc32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32', 'volume_size': 1} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2117069015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8207e390-e800-4d1f-b63c-f3ca5f15dc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c42e99a539473e89c488a36c3879ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:43Z,use_quota=True,user_id='b78fc3c3e7794dfeb67e297ab64d2899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Creating volume 8207e390-e800-4d1f-b63c-f3ca5f15dc32 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:13:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:13:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:43 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 1073741824 Jul 07 15:13:43 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:44 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 1073741824" returned: 0 in 1.072s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:44 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 Jul 07 15:13:44 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:45 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32" returned: 0 in 0.719s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:13:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0e6165-70ce-4673-9334-0b135dc1a59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc74280-b1b0-4456-925c-1833638957f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:45 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Volume volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 (8207e390-e800-4d1f-b63c-f3ca5f15dc32): created successfully Jul 07 15:13:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc74280-b1b0-4456-925c-1833638957f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Flow 'volume_create_manager' (067c68e4-ec9f-4e47-bb5b-a5bf2725020f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f74af5c5-5209-4a2f-9fa9-3c14084d7ba0 tempest-VolumesTransfersTest-628841717 None] Created volume successfully. Jul 07 15:13:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Acquiring lock "cinder-8207e390-e800-4d1f-b63c-f3ca5f15dc32-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-8207e390-e800-4d1f-b63c-f3ca5f15dc32-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Acquiring lock "cinder-quobyte-8207e390-e800-4d1f-b63c-f3ca5f15dc32" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-quobyte-8207e390-e800-4d1f-b63c-f3ca5f15dc32" acquired by "delete_volume" :: waited 0.046s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8400273d-cf64-4bfe-ad8f-e1b5f81e0f1e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:47 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 Jul 07 15:13:47 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:48 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32" returned: 0 in 1.087s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:48 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32 Jul 07 15:13:48 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:48 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8207e390-e800-4d1f-b63c-f3ca5f15dc32" returned: 0 in 0.815s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-quobyte-8207e390-e800-4d1f-b63c-f3ca5f15dc32" released by "delete_volume" :: held 2.055s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Created reservations ['3691bb02-48a6-46e5-b487-acdc22a424b5', '54258c94-2e50-4918-932c-e5e0d008ecfb', 'e27ba1f4-dffc-4066-a8ef-a07043935c49', '8d2a5d53-5f4d-49c1-8fb9-0b99df6f72dc'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:49 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:49 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:49 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.766s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Deleted volume successfully. Jul 07 15:13:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a52e2054-b23d-415a-85d5-7998811fef12 tempest-VolumesTransfersTest-48567683 None] Lock "cinder-8207e390-e800-4d1f-b63c-f3ca5f15dc32-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "cinder-1b7614f4-859c-4929-8d6b-8c5be17151c4-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-1b7614f4-859c-4929-8d6b-8c5be17151c4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "cinder-quobyte-1b7614f4-859c-4929-8d6b-8c5be17151c4" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-quobyte-1b7614f4-859c-4929-8d6b-8c5be17151c4" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:53 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc64fe1-afa3-4595-aabd-77a8c6dc1e15]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:53 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 Jul 07 15:13:53 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:54 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4" returned: 0 in 0.891s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:54 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4 Jul 07 15:13:54 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:55 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1b7614f4-859c-4929-8d6b-8c5be17151c4" returned: 0 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-quobyte-1b7614f4-859c-4929-8d6b-8c5be17151c4" released by "delete_volume" :: held 1.734s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Created reservations ['fa486133-06b2-4850-bd72-d8644f4201fa', 'c4ea7044-030e-42ac-b50a-8552a9ad1b76', 'fda744ca-5e4d-40e8-a3aa-4d0d66d8ddef', '36d45ac5-3bd5-4ea9-9cb1-b001de88d00a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:55 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:55 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "cinder-8f66807f-dc81-4cfc-a437-ee8f746bd77e-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-8f66807f-dc81-4cfc-a437-ee8f746bd77e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "cinder-quobyte-8f66807f-dc81-4cfc-a437-ee8f746bd77e" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-quobyte-8f66807f-dc81-4cfc-a437-ee8f746bd77e" acquired by "delete_volume" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[69279682-f1dc-4939-80c2-5117304b64f7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:56 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e Jul 07 15:13:56 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:56 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.883s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Deleted volume successfully. Jul 07 15:13:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-261aeeb4-38cf-419a-89d9-524e73b253d6 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-1b7614f4-859c-4929-8d6b-8c5be17151c4-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Flow 'volume_create_manager' (48c898c2-f18b-4a98-8138-991cb2eda29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e0f9bd-0714-4e9c-85e3-5cb5c4b0b32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e0f9bd-0714-4e9c-85e3-5cb5c4b0b32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-294029150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd451f-6750-45c5-8309-46f7517e3cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e482bb4b104c64bbc52753e7132a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:57Z,use_quota=True,user_id='7de1dedd41754af69370e008662d8c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2222c84-4f51-4acf-aa54-bfef2ef1f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2222c84-4f51-4acf-aa54-bfef2ef1f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fa61f7-bf46-4e5d-8133-3db87320d8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fa61f7-bf46-4e5d-8133-3db87320d8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edd451f-6750-45c5-8309-46f7517e3cdc', 'volume_name': 'volume-2edd451f-6750-45c5-8309-46f7517e3cdc', 'volume_size': 2}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88bc44c-3160-4e9e-b425-40c29b885aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88bc44c-3160-4e9e-b425-40c29b885aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4880c179-df68-428b-b4fb-2cecf3177f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:57 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Volume 2edd451f-6750-45c5-8309-46f7517e3cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edd451f-6750-45c5-8309-46f7517e3cdc', 'volume_size': 2} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-294029150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd451f-6750-45c5-8309-46f7517e3cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e482bb4b104c64bbc52753e7132a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:57Z,use_quota=True,user_id='7de1dedd41754af69370e008662d8c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Creating volume 2edd451f-6750-45c5-8309-46f7517e3cdc {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:13:57 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc 2147483648 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:57 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc 2147483648 Jul 07 15:13:57 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:57 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e" returned: 0 in 1.111s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:57 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e Jul 07 15:13:57 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:58 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8f66807f-dc81-4cfc-a437-ee8f746bd77e" returned: 0 in 0.858s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-quobyte-8f66807f-dc81-4cfc-a437-ee8f746bd77e" released by "delete_volume" :: held 2.016s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Flow 'volume_create_manager' (80511ff2-f3d0-410c-9c9a-d0a8753552d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459edbaf-63b0-4b6a-948a-21d6f1f6aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459edbaf-63b0-4b6a-948a-21d6f1f6aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1480756611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680a4a8f8523403c86b2e268f4c6357f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:58Z,use_quota=True,user_id='38796e62a7b646ebb692aadd0db652b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d206be9-3734-498e-a730-20bd7420a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d206be9-3734-498e-a730-20bd7420a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc8f35a-df8f-4705-9816-263e18445a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc8f35a-df8f-4705-9816-263e18445a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82', 'volume_name': 'volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef811da0-cf8b-4a6d-a75a-72d4d76702d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef811da0-cf8b-4a6d-a75a-72d4d76702d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d0969-3182-4b54-91fd-1eb6a1583335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:58 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Volume 42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82', 'volume_size': 1} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:58 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Created reservations ['bb630886-9ed0-4e7e-b9cf-4b7004252270', '02749688-6237-447a-9ddc-cf97661b1a02', '290e79e0-3ffc-4f64-8dc3-160859476494', '8f66a530-3607-401e-9e0c-0b6cdd31c4c5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc 2147483648" returned: 0 in 1.180s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:58 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc Jul 07 15:13:58 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:58 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:13:58 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:59 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc" returned: 0 in 0.750s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1480756611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680a4a8f8523403c86b2e268f4c6357f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:13:58Z,use_quota=True,user_id='38796e62a7b646ebb692aadd0db652b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Creating volume 42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:13:59 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:13:59 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.732s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:13:59 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 1073741824 Jul 07 15:13:59 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4880c179-df68-428b-b4fb-2cecf3177f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edd451f-6750-45c5-8309-46f7517e3cdc', 'volume_size': 2}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8310fb-e890-4ad2-9030-51487d74528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:13:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Deleted volume successfully. Jul 07 15:13:59 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Volume volume-2edd451f-6750-45c5-8309-46f7517e3cdc (2edd451f-6750-45c5-8309-46f7517e3cdc): created successfully Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8310fb-e890-4ad2-9030-51487d74528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Flow 'volume_create_manager' (48c898c2-f18b-4a98-8138-991cb2eda29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d9a53468-c674-4fab-a1b1-e4c066bfbf50 tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-8f66807f-dc81-4cfc-a437-ee8f746bd77e-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:13:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e73fb332-73fe-46ac-a67d-f0b0407665f6 tempest-VolumesCloneNegativeTest-1938458080 None] Created volume successfully. Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "cinder-aa4dfe30-d726-490c-b598-4923dae231bb-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-aa4dfe30-d726-490c-b598-4923dae231bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "cinder-quobyte-aa4dfe30-d726-490c-b598-4923dae231bb" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-quobyte-aa4dfe30-d726-490c-b598-4923dae231bb" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1af64c-3dde-4528-8a8f-3caf1a86b7f8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:13:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:00 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb Jul 07 15:14:00 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:00 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:00 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:00 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 1073741824" returned: 0 in 0.887s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:00 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 Jul 07 15:14:00 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Acquiring lock "cinder-2edd451f-6750-45c5-8309-46f7517e3cdc-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Lock "cinder-2edd451f-6750-45c5-8309-46f7517e3cdc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Acquiring lock "cinder-quobyte-2edd451f-6750-45c5-8309-46f7517e3cdc" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Lock "cinder-quobyte-2edd451f-6750-45c5-8309-46f7517e3cdc" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[037fd291-966b-49bd-a57c-3a3b2dd34491]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:00 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:14:00 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc Jul 07 15:14:00 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:00 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb" returned: 0 in 1.034s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:00 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb Jul 07 15:14:00 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:01 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" returned: 0 in 0.794s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d0969-3182-4b54-91fd-1eb6a1583335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c1e2a-098b-4fcf-bf5f-6853247b9f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:01 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Volume volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 (42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82): created successfully Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739c1e2a-098b-4fcf-bf5f-6853247b9f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Flow 'volume_create_manager' (80511ff2-f3d0-410c-9c9a-d0a8753552d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8cda0dbd-0277-408c-8bb2-963e242cb225 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Created volume successfully. Jul 07 15:14:01 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc" returned: 0 in 0.829s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:01 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc Jul 07 15:14:01 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:01 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-aa4dfe30-d726-490c-b598-4923dae231bb" returned: 0 in 0.734s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-quobyte-aa4dfe30-d726-490c-b598-4923dae231bb" released by "delete_volume" :: held 1.823s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Created reservations ['10d0d371-b156-4c4a-87e1-67c25b43e8aa', '695c35cc-1622-4b7e-a7c6-76c7e8c57503', 'd351d341-7bb4-46ba-992f-3739dec5cc37', '8cb20635-7e23-46c6-a4b0-14532504a155'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:01 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:01 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Creating offline snapshot c2f3a63a-f28b-45e9-a9a2-224d69af047d of volume 42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4636b-23a3-4a15-809b-c903ee344ffb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:02 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 Jul 07 15:14:02 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:02 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2edd451f-6750-45c5-8309-46f7517e3cdc" returned: 0 in 0.749s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Lock "cinder-quobyte-2edd451f-6750-45c5-8309-46f7517e3cdc" released by "delete_volume" :: held 1.641s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Created reservations ['85edf916-b633-4773-8e53-7db51fed620b', 'd97028ff-0601-4868-bac8-f67a31ca8f7c', '813d6fca-1abb-489d-a07c-42f16cb62a2b', 'a8644130-7e66-45e9-8a9c-92265132f14a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:02 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:02 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:02 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.722s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:02 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Deleted volume successfully. Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fcf7edf-f333-4a9d-80fc-0e34068f812b tempest-AttachVolumeNegativeTest-620314878 None] Lock "cinder-aa4dfe30-d726-490c-b598-4923dae231bb-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:02 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" returned: 0 in 0.943s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:02 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d 1G Jul 07 15:14:02 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:03 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.862s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:03 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Deleted volume successfully. Jul 07 15:14:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bb6e73b-fd57-4b8e-92e5-758d5c26364e tempest-VolumesCloneNegativeTest-1938458080 None] Lock "cinder-2edd451f-6750-45c5-8309-46f7517e3cdc-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:03 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d 1G" returned: 0 in 1.036s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:03 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d Jul 07 15:14:03 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:04 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d" returned: 0 in 0.889s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:04 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d is being set with open permissions: ugo+rw Jul 07 15:14:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:04 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d Jul 07 15:14:04 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:05 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d" returned: 0 in 0.966s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:05 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.info Jul 07 15:14:05 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:06 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.info" returned: 0 in 1.036s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:06 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.info is being set with open permissions: ugo+rw Jul 07 15:14:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:06 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.info Jul 07 15:14:06 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:07 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.info" returned: 0 in 0.770s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.772s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:07 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-676508a2-305e-402b-a194-96f68b71cb8c tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Create snapshot completed successfully Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "cinder-c2f3a63a-f28b-45e9-a9a2-224d69af047d-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-c2f3a63a-f28b-45e9-a9a2-224d69af047d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "cinder-quobyte-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-quobyte-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "cinder-quobyte-c2f3a63a-f28b-45e9-a9a2-224d69af047d" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-quobyte-c2f3a63a-f28b-45e9-a9a2-224d69af047d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Deleting offline snapshot c2f3a63a-f28b-45e9-a9a2-224d69af047d of volume 42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] snapshot_file for this snap is: volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab83b1-f15b-4583-a1d8-6691070177ab]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:09 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d Jul 07 15:14:09 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:09 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d" returned: 0 in 0.921s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:14:09 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18b0fff-bc2f-4ac8-9787-1dafdc47c49b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:10 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 Jul 07 15:14:10 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:10 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" returned: 0 in 0.914s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:10 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d Jul 07 15:14:10 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:12 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d" returned: 0 in 1.238s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:12 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d Jul 07 15:14:12 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:12 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82.c2f3a63a-f28b-45e9-a9a2-224d69af047d" returned: 0 in 0.805s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-quobyte-c2f3a63a-f28b-45e9-a9a2-224d69af047d" released by "_delete_snapshot" :: held 4.039s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-quobyte-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" released by "delete_snapshot" :: held 4.076s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:12 devstack cinder-volume[87257]: WARNING cinder.quota [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Created reservations ['ddca18ae-2afa-4415-b297-95e2699901d3', '2532f230-ffbf-4e6f-9a78-1f1c50549cb7', 'd4af8ad0-0b09-4585-9ae8-89e17b034cac', '105c1706-91c0-4075-bc00-ccd91518c74a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Delete snapshot completed successfully. Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b1439b5a-3a20-4947-8a6b-d25602baf4cb tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-c2f3a63a-f28b-45e9-a9a2-224d69af047d-delete_snapshot" released by "delete_snapshot" :: held 4.296s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "cinder-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "cinder-quobyte-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-quobyte-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1b95a-7118-4f26-be1e-c2f3f63fa087]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:13 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 Jul 07 15:14:13 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:14 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" returned: 0 in 1.066s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:14 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82 Jul 07 15:14:14 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:15 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" returned: 0 in 1.087s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-quobyte-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82" released by "delete_volume" :: held 2.254s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Created reservations ['cc53e1ba-0111-4483-a4b8-47dfac9f1ebb', '4cf709c4-fbf3-4b8b-b0b7-031515442d49', '827b6516-08c3-4c92-8a04-644f8567f13a', '7b6b7049-26b3-4c7f-bd35-2a6fccb9e6c3'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:15 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:15 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:17 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.221s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:17 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:17 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Deleted volume successfully. Jul 07 15:14:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7c454e4-f35d-4641-ae2c-2ca031d61907 tempest-VolumeSnapshotQuotasNegativeTestJSON-331151593 None] Lock "cinder-42f5a0ee-b9ab-4ba5-8957-2bdc23f3ba82-delete_volume" released by "delete_volume" :: held 3.929s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-365b2fb2-a12c-4295-a2ea-7dba53348491 tempest-GroupSnapshotsV319Test-843920434 None] Group tempest-GroupSnapshotsV319Test-Group-2004339850: creating Jul 07 15:14:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-365b2fb2-a12c-4295-a2ea-7dba53348491 tempest-GroupSnapshotsV319Test-843920434 None] Group tempest-GroupSnapshotsV319Test-Group-2004339850: created successfully Jul 07 15:14:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-365b2fb2-a12c-4295-a2ea-7dba53348491 tempest-GroupSnapshotsV319Test-843920434 None] Create group completed successfully. Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=115,cinder:SELECT=82,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=118,cinder:SELECT=93,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Flow 'volume_create_manager' (9561262f-bbba-4095-b9c8-e4deb053eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25c39cd-5e61-44ef-a0a6-9ec032eafb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25c39cd-5e61-44ef-a0a6-9ec032eafb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112276364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0710ae5-d9aa-46b0-9678-ca2e59a05bae,host='devstack@QuobyteHD#QuobyteHD',id=21ed2147-3653-4968-9002-121aadd51bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d3eca02855449687ecb64a1dfea22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:21Z,use_quota=True,user_id='9161c4682a4945c1b47db89c72e33fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87890fa-bca3-4e76-8214-e1fbea0421ea),volume_type_id=e87890fa-bca3-4e76-8214-e1fbea0421ea)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d472346-7201-4173-820e-3623f4bd4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d472346-7201-4173-820e-3623f4bd4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b67c332-7e84-424b-b1fa-575d2257d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b67c332-7e84-424b-b1fa-575d2257d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ed2147-3653-4968-9002-121aadd51bb6', 'volume_name': 'volume-21ed2147-3653-4968-9002-121aadd51bb6', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fb1b7d-e71c-4c7a-b472-415a700ff91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fb1b7d-e71c-4c7a-b472-415a700ff91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261cbdbc-60ac-44f6-869f-84a0629d3177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Volume 21ed2147-3653-4968-9002-121aadd51bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ed2147-3653-4968-9002-121aadd51bb6', 'volume_size': 1} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0710ae5-d9aa-46b0-9678-ca2e59a05bae,created_at=2026-07-07T13:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112276364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0710ae5-d9aa-46b0-9678-ca2e59a05bae,host='devstack@QuobyteHD#QuobyteHD',id=21ed2147-3653-4968-9002-121aadd51bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d3eca02855449687ecb64a1dfea22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:21Z,use_quota=True,user_id='9161c4682a4945c1b47db89c72e33fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87890fa-bca3-4e76-8214-e1fbea0421ea),volume_type_id=e87890fa-bca3-4e76-8214-e1fbea0421ea)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Creating volume 21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:21 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:21 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 1073741824 Jul 07 15:14:21 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:22 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 1073741824" returned: 0 in 1.285s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:22 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 Jul 07 15:14:22 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:23 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6" returned: 0 in 0.968s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261cbdbc-60ac-44f6-869f-84a0629d3177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ed2147-3653-4968-9002-121aadd51bb6', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4af432e-2131-498b-82da-f5e78ab2f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Volume volume-21ed2147-3653-4968-9002-121aadd51bb6 (21ed2147-3653-4968-9002-121aadd51bb6): created successfully Jul 07 15:14:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4af432e-2131-498b-82da-f5e78ab2f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Flow 'volume_create_manager' (9561262f-bbba-4095-b9c8-e4deb053eebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-54178991-248c-41bd-82c1-7995a0b9cbdb tempest-GroupSnapshotsV319Test-843920434 None] Created volume successfully. Jul 07 15:14:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] GroupSnapshot 4f71a4ab-21cd-4a9d-b4cc-8a9b762a5906: creating. Jul 07 15:14:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Group snapshot 4f71a4ab-21cd-4a9d-b4cc-8a9b762a5906: creating. {{(pid=87257) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 15:14:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Creating offline snapshot 56755776-4740-4f1e-b2bb-39e984aa4a33 of volume 21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:14:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c44c72-0138-4294-827d-690af04422b9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:25 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 Jul 07 15:14:25 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (ef17a816-7714-422a-a36d-2a79c27c2d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72030a7a-3aea-4aa5-8a21-a47372250d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72030a7a-3aea-4aa5-8a21-a47372250d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880521437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d2e273-1a8f-4ba9-ba88-411e51b3342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:26Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff3d741-3c51-4da3-8ad5-7088d24d2515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff3d741-3c51-4da3-8ad5-7088d24d2515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46e6e8f-7b0f-4e96-98e9-255b5c601068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46e6e8f-7b0f-4e96-98e9-255b5c601068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d2e273-1a8f-4ba9-ba88-411e51b3342c', 'volume_name': 'volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fd17ae-d034-4262-a732-82f10b00fb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fd17ae-d034-4262-a732-82f10b00fb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97994ec4-76a5-4262-8637-79ba43bbcaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:26 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Volume f5d2e273-1a8f-4ba9-ba88-411e51b3342c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c', 'volume_size': 1} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:26 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6" returned: 0 in 0.852s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:26 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 1G Jul 07 15:14:26 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:27 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 1G" returned: 0 in 0.834s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ed2147-3653-4968-9002-121aadd51bb6 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:27 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ed2147-3653-4968-9002-121aadd51bb6 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 Jul 07 15:14:27 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:28 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ed2147-3653-4968-9002-121aadd51bb6 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:28 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:14:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:28 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 Jul 07 15:14:28 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:28 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33" returned: 0 in 0.674s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:29 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.info Jul 07 15:14:29 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:29 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.info" returned: 0 in 0.684s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:29 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 15:14:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:29 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.info Jul 07 15:14:29 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:30 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.info" returned: 0 in 0.704s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.241s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880521437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d2e273-1a8f-4ba9-ba88-411e51b3342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:26Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Creating volume f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:30 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:30 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c 1073741824 Jul 07 15:14:30 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-367d25e1-35c8-45d9-95e2-b11dad63b8ac tempest-GroupSnapshotsV319Test-843920434 None] group_snapshot 4f71a4ab-21cd-4a9d-b4cc-8a9b762a5906: created successfully Jul 07 15:14:31 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c 1073741824" returned: 0 in 0.937s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:31 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c Jul 07 15:14:31 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] group_snapshot 4f71a4ab-21cd-4a9d-b4cc-8a9b762a5906: deleting Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] group_snapshot 4f71a4ab-21cd-4a9d-b4cc-8a9b762a5906: deleting {{(pid=87257) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Acquiring lock "cinder-quobyte-21ed2147-3653-4968-9002-121aadd51bb6" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Lock "cinder-quobyte-21ed2147-3653-4968-9002-121aadd51bb6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Acquiring lock "cinder-quobyte-56755776-4740-4f1e-b2bb-39e984aa4a33" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Lock "cinder-quobyte-56755776-4740-4f1e-b2bb-39e984aa4a33" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Deleting offline snapshot 56755776-4740-4f1e-b2bb-39e984aa4a33 of volume 21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] snapshot_file for this snap is: volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f66a71f-6226-4fd8-a551-8ab4cd5ba4df]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:31 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 Jul 07 15:14:31 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:32 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" returned: 0 in 1.024s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97994ec4-76a5-4262-8637-79ba43bbcaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5b9364-9c41-46d3-8675-daecaa1804f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Volume volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c (f5d2e273-1a8f-4ba9-ba88-411e51b3342c): created successfully Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5b9364-9c41-46d3-8675-daecaa1804f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (ef17a816-7714-422a-a36d-2a79c27c2d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Flow 'volume_create_manager' (a5ed6142-7c6a-419c-b40b-701b9931ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851d88fa-76b0-49a0-9d26-b1da8ffc6f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:32 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6266e844-04ba-48f2-9e89-a03b1617d18d tempest-VolumesSnapshotTestJSON-540025096 None] Created volume successfully. Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851d88fa-76b0-49a0-9d26-b1da8ffc6f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1738766309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f91682-cf93-4255-af29-dad8ad41667a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553c13428c44f75882e99bc06927ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:32Z,use_quota=True,user_id='0ff1ee0cb90d41f4b5917936677627bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb87877-b904-4352-8315-2b10f2ab24ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb87877-b904-4352-8315-2b10f2ab24ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e89875-fa70-49ef-a6f2-40f8af47316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e89875-fa70-49ef-a6f2-40f8af47316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f91682-cf93-4255-af29-dad8ad41667a', 'volume_name': 'volume-d2f91682-cf93-4255-af29-dad8ad41667a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32753898-01a4-42ec-800c-b1c6d12a1535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32753898-01a4-42ec-800c-b1c6d12a1535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0937583c-f9ca-496a-86b6-34e5d7733a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Volume d2f91682-cf93-4255-af29-dad8ad41667a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f91682-cf93-4255-af29-dad8ad41667a', 'volume_size': 1} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1738766309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f91682-cf93-4255-af29-dad8ad41667a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553c13428c44f75882e99bc06927ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:32Z,use_quota=True,user_id='0ff1ee0cb90d41f4b5917936677627bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Creating volume d2f91682-cf93-4255-af29-dad8ad41667a {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:32 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:32 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a 1073741824 Jul 07 15:14:32 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:32 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33" returned: 0 in 0.962s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ed2147-3653-4968-9002-121aadd51bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bda660-df3e-4be5-9c1e-8af4a07fcfe2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:32 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 Jul 07 15:14:32 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:33 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a 1073741824" returned: 0 in 0.928s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:33 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a Jul 07 15:14:33 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:33 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6" returned: 0 in 0.811s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:33 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 Jul 07 15:14:33 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:34 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a" returned: 0 in 0.765s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.484s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0937583c-f9ca-496a-86b6-34e5d7733a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f91682-cf93-4255-af29-dad8ad41667a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09ccd5a-f837-40bd-a711-9ffa62909caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Creating offline snapshot 1a5ab7f0-ef1c-434b-a194-c333c152c422 of volume f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:14:34 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Volume volume-d2f91682-cf93-4255-af29-dad8ad41667a (d2f91682-cf93-4255-af29-dad8ad41667a): created successfully Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09ccd5a-f837-40bd-a711-9ffa62909caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Flow 'volume_create_manager' (a5ed6142-7c6a-419c-b40b-701b9931ada9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c79b1-d37b-4fe5-9f5e-a4c182e7c8b3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-35c9f9dc-0dc6-40fe-a4f3-64299498495c tempest-VolumesListAdminTestJSON-1406874277 None] Created volume successfully. Jul 07 15:14:34 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33" returned: 0 in 0.849s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:34 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c Jul 07 15:14:34 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:34 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33 Jul 07 15:14:34 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Flow 'volume_create_manager' (62dfed94-deb9-492b-ad59-4f50b4c4307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e0859c-8ed1-428b-aaf5-43fe081fd181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e0859c-8ed1-428b-aaf5-43fe081fd181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1566604523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6628ec4-9537-42aa-aa08-448c2e9c8c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553c13428c44f75882e99bc06927ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:35Z,use_quota=True,user_id='0ff1ee0cb90d41f4b5917936677627bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59667fd3-1d5c-4429-8f1d-3a29a5d3e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59667fd3-1d5c-4429-8f1d-3a29a5d3e43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91ae15a-6e2f-4b19-8713-b14dc540e4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91ae15a-6e2f-4b19-8713-b14dc540e4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6628ec4-9537-42aa-aa08-448c2e9c8c35', 'volume_name': 'volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bca39af-1296-4cda-9692-44d0596ea334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bca39af-1296-4cda-9692-44d0596ea334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8937408-c24a-47cb-babe-69ba6169bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:35 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Volume f6628ec4-9537-42aa-aa08-448c2e9c8c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35', 'volume_size': 1} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:35 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6.56755776-4740-4f1e-b2bb-39e984aa4a33" returned: 0 in 0.738s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Lock "cinder-quobyte-56755776-4740-4f1e-b2bb-39e984aa4a33" released by "_delete_snapshot" :: held 3.490s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:35 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" returned: 0 in 0.871s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Lock "cinder-quobyte-21ed2147-3653-4968-9002-121aadd51bb6" released by "delete_snapshot" :: held 3.542s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:35 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 1G Jul 07 15:14:35 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:35 devstack cinder-volume[87257]: WARNING cinder.quota [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-988496275 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-988496275, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:14:35 devstack cinder-volume[87257]: WARNING cinder.quota [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-988496275 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-988496275, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:14:35 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] Created reservations ['87cdfa22-c471-42ee-8a1b-423b93baa629', '94bc8474-f000-4622-9cab-18a4c09dccb5', 'd24bf9f5-41e8-4f63-9994-6b2589385aab', '3e573e24-aad7-477c-8981-0852b2998467'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-adbfb3bf-0b84-4020-9e0e-62a7d3ae4d1f tempest-GroupSnapshotsV319Test-843920434 None] group_snapshot 4f71a4ab-21cd-4a9d-b4cc-8a9b762a5906: deleted successfully Jul 07 15:14:36 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 1G" returned: 0 in 0.852s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:36 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 Jul 07 15:14:36 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Acquiring lock "cinder-quobyte-21ed2147-3653-4968-9002-121aadd51bb6" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Lock "cinder-quobyte-21ed2147-3653-4968-9002-121aadd51bb6" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb2cb8a-8c4e-4032-9e82-bfad94bcd573]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:36 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 Jul 07 15:14:36 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:36 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422" returned: 0 in 0.723s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:36 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 is being set with open permissions: ugo+rw Jul 07 15:14:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:36 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 Jul 07 15:14:36 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:37 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6" returned: 0 in 0.829s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:37 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6 Jul 07 15:14:37 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:37 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:37 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.info Jul 07 15:14:37 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:37 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-21ed2147-3653-4968-9002-121aadd51bb6" returned: 0 in 0.666s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Lock "cinder-quobyte-21ed2147-3653-4968-9002-121aadd51bb6" released by "delete_volume" :: held 1.582s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Created reservations ['10c844ab-9da8-4919-8df4-5c080558fdc5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:38 devstack cinder-volume[87257]: WARNING cinder.quota [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-988496275 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-988496275, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Created reservations ['b026e8da-2abc-4b8f-a11a-68c1d74843ce', '8418c3b1-b1ff-413d-9ed9-4b79185641d0', '00826d79-10a5-4b17-b88c-cd984e62c12b', 'ae9a2196-1558-4b8d-83c0-2384586045d7'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:38 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:38 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:38 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.info" returned: 0 in 0.696s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:38 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.info is being set with open permissions: ugo+rw Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:38 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.info Jul 07 15:14:38 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:38 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.687s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0551f3c1-21a8-44cd-bc44-8baaa2b5ba2c tempest-GroupSnapshotsV319Test-843920434 None] Delete group completed successfully. Jul 07 15:14:38 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.info" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.624s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.784s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1566604523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6628ec4-9537-42aa-aa08-448c2e9c8c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553c13428c44f75882e99bc06927ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:35Z,use_quota=True,user_id='0ff1ee0cb90d41f4b5917936677627bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Creating volume f6628ec4-9537-42aa-aa08-448c2e9c8c35 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:38 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:38 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 1073741824 Jul 07 15:14:38 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5fd37480-5d5f-4d78-82c1-41b16144132c tempest-VolumesSnapshotTestJSON-540025096 None] Create snapshot completed successfully Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Flow 'volume_create_manager' (cbd86788-536f-455e-bc93-d60bd78994ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b651722b-79f4-4ada-8574-6d55aeef2180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b651722b-79f4-4ada-8574-6d55aeef2180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1936010208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abef784-f8b7-418c-a376-303e036f0c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a065e1bac4a54dbc83a6ee8b4c68a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:40Z,use_quota=True,user_id='66a0d23373b24cb985f2f966c31afaac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9563288-288b-484d-ba17-801cc606c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9563288-288b-484d-ba17-801cc606c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ab775d-a84b-4b3e-ade8-b3c844762c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ab775d-a84b-4b3e-ade8-b3c844762c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abef784-f8b7-418c-a376-303e036f0c87', 'volume_name': 'volume-5abef784-f8b7-418c-a376-303e036f0c87', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad468bf-5c4d-4468-93e3-36421b8c0e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad468bf-5c4d-4468-93e3-36421b8c0e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8330f93-f546-4781-8a8a-7aa9da8e5f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Volume 5abef784-f8b7-418c-a376-303e036f0c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abef784-f8b7-418c-a376-303e036f0c87', 'volume_size': 1} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:39 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 1073741824" returned: 0 in 0.929s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:39 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 Jul 07 15:14:39 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-1a5ab7f0-ef1c-434b-a194-c333c152c422-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-1a5ab7f0-ef1c-434b-a194-c333c152c422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-1a5ab7f0-ef1c-434b-a194-c333c152c422" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-1a5ab7f0-ef1c-434b-a194-c333c152c422" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Deleting offline snapshot 1a5ab7f0-ef1c-434b-a194-c333c152c422 of volume f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] snapshot_file for this snap is: volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52503e-ccec-43d4-80fc-0bddf75295b5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:40 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 Jul 07 15:14:40 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:40 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1936010208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abef784-f8b7-418c-a376-303e036f0c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a065e1bac4a54dbc83a6ee8b4c68a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:40Z,use_quota=True,user_id='66a0d23373b24cb985f2f966c31afaac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Creating volume 5abef784-f8b7-418c-a376-303e036f0c87 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:40 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8937408-c24a-47cb-babe-69ba6169bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b4624f-9889-48d0-b577-93b26261ea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:40 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 1073741824 Jul 07 15:14:40 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:40 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Volume volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 (f6628ec4-9537-42aa-aa08-448c2e9c8c35): created successfully Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b4624f-9889-48d0-b577-93b26261ea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Flow 'volume_create_manager' (62dfed94-deb9-492b-ad59-4f50b4c4307d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-581b2b7a-5245-4157-95c0-a2361bc873b9 tempest-VolumesListAdminTestJSON-1406874277 None] Created volume successfully. Jul 07 15:14:41 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422" returned: 0 in 0.869s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:14:41 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a6bb1-0431-4d6e-87ed-4427fcf39d61]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:41 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c Jul 07 15:14:41 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:41 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 1073741824" returned: 0 in 0.978s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:41 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 Jul 07 15:14:41 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Flow 'volume_create_manager' (c8f65677-e310-4b0a-840c-a065e075ba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8391b602-e465-43b7-ac80-72f320e47bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8391b602-e465-43b7-ac80-72f320e47bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-925097431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbbab88-cf1b-43ae-9e24-9efde8511594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553c13428c44f75882e99bc06927ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:42Z,use_quota=True,user_id='0ff1ee0cb90d41f4b5917936677627bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131fc36b-069d-4cba-aa42-a002d7702a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131fc36b-069d-4cba-aa42-a002d7702a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd90837-1d01-4bca-aaf3-465ebc8dfc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd90837-1d01-4bca-aaf3-465ebc8dfc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbbab88-cf1b-43ae-9e24-9efde8511594', 'volume_name': 'volume-edbbab88-cf1b-43ae-9e24-9efde8511594', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3c60d1-e1fe-4402-9259-541960dae5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3c60d1-e1fe-4402-9259-541960dae5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef90f0e-dcc2-4879-b306-3c1824253b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:42 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Volume edbbab88-cf1b-43ae-9e24-9efde8511594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbbab88-cf1b-43ae-9e24-9efde8511594', 'volume_size': 1} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:42 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" returned: 0 in 1.022s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:42 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 Jul 07 15:14:42 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:42 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-925097431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbbab88-cf1b-43ae-9e24-9efde8511594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553c13428c44f75882e99bc06927ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:42Z,use_quota=True,user_id='0ff1ee0cb90d41f4b5917936677627bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Creating volume edbbab88-cf1b-43ae-9e24-9efde8511594 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:42 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8330f93-f546-4781-8a8a-7aa9da8e5f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abef784-f8b7-418c-a376-303e036f0c87', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a88e915-464f-432a-9343-281974cb384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:42 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 1073741824 Jul 07 15:14:42 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:42 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Volume volume-5abef784-f8b7-418c-a376-303e036f0c87 (5abef784-f8b7-418c-a376-303e036f0c87): created successfully Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a88e915-464f-432a-9343-281974cb384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Flow 'volume_create_manager' (cbd86788-536f-455e-bc93-d60bd78994ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:42 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2f0aaefc-d85a-4f63-9c8f-9e230a4b53d4 tempest-AttachVolumeTestJSON-1298375289 None] Created volume successfully. Jul 07 15:14:43 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:43 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422 Jul 07 15:14:43 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:43 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 1073741824" returned: 0 in 1.005s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:43 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 Jul 07 15:14:43 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:43 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c.1a5ab7f0-ef1c-434b-a194-c333c152c422" returned: 0 in 0.680s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-1a5ab7f0-ef1c-434b-a194-c333c152c422" released by "_delete_snapshot" :: held 3.490s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" released by "delete_snapshot" :: held 3.514s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['ac2df94a-6a1b-428a-a53e-ea5fe70f538e', '42949e9c-5944-4bf8-8eb3-393b9cfe4240', 'd06b2404-a2d4-4eb0-8871-2bff77bfb42e', '5cadfb16-27dd-4141-83c9-6327580db694'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Delete snapshot completed successfully. Jul 07 15:14:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-be8d31f4-c0e8-4556-815a-d8648f12edfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-1a5ab7f0-ef1c-434b-a194-c333c152c422-delete_snapshot" released by "delete_snapshot" :: held 3.687s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:44 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef90f0e-dcc2-4879-b306-3c1824253b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbbab88-cf1b-43ae-9e24-9efde8511594', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c10ea15-1def-45e6-85cd-9e217ccfd7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Volume volume-edbbab88-cf1b-43ae-9e24-9efde8511594 (edbbab88-cf1b-43ae-9e24-9efde8511594): created successfully Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c10ea15-1def-45e6-85cd-9e217ccfd7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Flow 'volume_create_manager' (c8f65677-e310-4b0a-840c-a065e075ba5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5979a281-ea59-47fb-89fd-fc168be2a461 tempest-VolumesListAdminTestJSON-1406874277 None] Created volume successfully. Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Flow 'volume_create_manager' (ed8c2572-d1e9-4cd0-bfd1-331c19e53c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fa00e1-bdaf-4054-aad3-fed988e0ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fa00e1-bdaf-4054-aad3-fed988e0ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1074503809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0efff3-0aca-4e63-abac-7adba40c2174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78001e795a9433980849465ecff03b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:45Z,use_quota=True,user_id='80fcc3bc24f7489d9fe8e6838a9e65d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ce4c6b-f9a2-4dc8-96da-982026151a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ce4c6b-f9a2-4dc8-96da-982026151a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b8e61c-699c-4564-9a15-31fd84979134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b8e61c-699c-4564-9a15-31fd84979134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0efff3-0aca-4e63-abac-7adba40c2174', 'volume_name': 'volume-7f0efff3-0aca-4e63-abac-7adba40c2174', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a855de36-594c-4e81-b65d-7318c6bd7350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a855de36-594c-4e81-b65d-7318c6bd7350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bf935e-5181-4dcb-b16f-078cd5a7d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Volume 7f0efff3-0aca-4e63-abac-7adba40c2174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0efff3-0aca-4e63-abac-7adba40c2174', 'volume_size': 1} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1074503809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0efff3-0aca-4e63-abac-7adba40c2174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78001e795a9433980849465ecff03b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:45Z,use_quota=True,user_id='80fcc3bc24f7489d9fe8e6838a9e65d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Creating volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:44 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:44 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 1073741824 Jul 07 15:14:44 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (e7669480-a237-4bb5-b7e5-83914f7d4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c3341-4fff-42ad-ba91-30f4e45387e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c3341-4fff-42ad-ba91-30f4e45387e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-30649124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2847c6ce-913c-4315-ade8-64360a2ea85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:45Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfafc550-85b5-4375-911e-a6639b79b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfafc550-85b5-4375-911e-a6639b79b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222dab6e-83cf-40bf-8b8d-70351cee1e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222dab6e-83cf-40bf-8b8d-70351cee1e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2847c6ce-913c-4315-ade8-64360a2ea85c', 'volume_name': 'volume-2847c6ce-913c-4315-ade8-64360a2ea85c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c107b886-8400-4d79-86e3-7a3aad26d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c107b886-8400-4d79-86e3-7a3aad26d77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d816d3-b7a8-4cfd-8c26-9a8b31ec1fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:45 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Volume 2847c6ce-913c-4315-ade8-64360a2ea85c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2847c6ce-913c-4315-ade8-64360a2ea85c', 'volume_size': 1} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:45 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 1073741824" returned: 0 in 0.946s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:45 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 Jul 07 15:14:45 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bd031592-7804-4f6c-a508-fdb557094f14 req-3d75ed42-121b-445a-9fe6-a30b16261af0 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Flow 'volume_create_manager' (33d65479-20b0-43d3-addd-6d60793fa300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d41148-a6a0-4da5-a6e2-b4736a50724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d41148-a6a0-4da5-a6e2-b4736a50724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8098bc98-7f59-4f0f-912b-d8a707fbf86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0981954c55dd4bcfb467051cf9bcfadc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:46Z,use_quota=True,user_id='3ecf157fb4e24457b823c669db00d465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b0189-bca9-461b-8234-aa79e8b3a3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b0189-bca9-461b-8234-aa79e8b3a3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be28e31-359f-4715-a5eb-43568dd1344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be28e31-359f-4715-a5eb-43568dd1344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8098bc98-7f59-4f0f-912b-d8a707fbf86a', 'volume_name': 'volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd3081-875d-443b-b090-a012650264f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd3081-875d-443b-b090-a012650264f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18378c71-0a79-4602-a698-9c6e13e3c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Volume 8098bc98-7f59-4f0f-912b-d8a707fbf86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a', 'volume_size': 1} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:46 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174" returned: 0 in 0.728s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-30649124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2847c6ce-913c-4315-ade8-64360a2ea85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:45Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Creating volume 2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:46 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bf935e-5181-4dcb-b16f-078cd5a7d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0efff3-0aca-4e63-abac-7adba40c2174', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:46 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c 1073741824 Jul 07 15:14:46 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf8501c-2fbc-4aa0-96dc-7e93bf8f7a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Volume volume-7f0efff3-0aca-4e63-abac-7adba40c2174 (7f0efff3-0aca-4e63-abac-7adba40c2174): created successfully Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf8501c-2fbc-4aa0-96dc-7e93bf8f7a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Flow 'volume_create_manager' (ed8c2572-d1e9-4cd0-bfd1-331c19e53c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f7b66dbf-3a56-4a8b-8a5d-da1a832c6575 tempest-SnapshotsActionsTest-1408577742 None] Created volume successfully. Jul 07 15:14:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:47 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c 1073741824" returned: 0 in 0.815s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:47 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c Jul 07 15:14:47 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:47 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c" returned: 0 in 0.639s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bd031592-7804-4f6c-a508-fdb557094f14 req-3d75ed42-121b-445a-9fe6-a30b16261af0 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.992s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d816d3-b7a8-4cfd-8c26-9a8b31ec1fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2847c6ce-913c-4315-ade8-64360a2ea85c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338bf9ae-16eb-4577-a08c-d9afc46fd456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[41588a95-f472-4852-ac3d-b5af60694eeb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-bd031592-7804-4f6c-a508-fdb557094f14 req-3d75ed42-121b-445a-9fe6-a30b16261af0 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Volume volume-2847c6ce-913c-4315-ade8-64360a2ea85c (2847c6ce-913c-4315-ade8-64360a2ea85c): created successfully Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338bf9ae-16eb-4577-a08c-d9afc46fd456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (e7669480-a237-4bb5-b7e5-83914f7d4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a63af48b-d3d8-4b0e-8932-72be9d74e044 tempest-VolumesSnapshotTestJSON-540025096 None] Created volume successfully. Jul 07 15:14:48 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 Jul 07 15:14:48 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:48 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-bd031592-7804-4f6c-a508-fdb557094f14 req-3d75ed42-121b-445a-9fe6-a30b16261af0 tempest-AttachVolumeTestJSON-1298375289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87" returned: 0 in 0.776s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bd031592-7804-4f6c-a508-fdb557094f14 req-3d75ed42-121b-445a-9fe6-a30b16261af0 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.666s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8098bc98-7f59-4f0f-912b-d8a707fbf86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0981954c55dd4bcfb467051cf9bcfadc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:46Z,use_quota=True,user_id='3ecf157fb4e24457b823c669db00d465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Creating volume 8098bc98-7f59-4f0f-912b-d8a707fbf86a {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:48 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:48 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a 1073741824 Jul 07 15:14:48 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bd031592-7804-4f6c-a508-fdb557094f14 req-3d75ed42-121b-445a-9fe6-a30b16261af0 tempest-AttachVolumeTestJSON-1298375289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-5abef784-f8b7-418c-a376-303e036f0c87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27445ba2-da18-43ee-9411-de7dc5ddc876', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:14:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-bd031592-7804-4f6c-a508-fdb557094f14 req-3d75ed42-121b-445a-9fe6-a30b16261af0 tempest-AttachVolumeTestJSON-1298375289 None] attachment_update completed successfully. Jul 07 15:14:49 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a 1073741824" returned: 0 in 0.844s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:49 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a Jul 07 15:14:49 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:50 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a" returned: 0 in 0.668s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.416s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18378c71-0a79-4602-a698-9c6e13e3c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5721572-a71f-4f2d-ab05-ad6cf2ac892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Creating offline snapshot a7d7b545-87a7-4330-858e-48b4d71afbe0 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:14:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Volume volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a (8098bc98-7f59-4f0f-912b-d8a707fbf86a): created successfully Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5721572-a71f-4f2d-ab05-ad6cf2ac892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Flow 'volume_create_manager' (33d65479-20b0-43d3-addd-6d60793fa300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a3c211-cbfe-4470-b229-bf4400110a7d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-12b7a2a3-5519-48eb-893d-02c6bb9f0770 tempest-VolumesListAdminTestJSON-750606456 None] Created volume successfully. Jul 07 15:14:50 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 Jul 07 15:14:50 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:51 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174" returned: 0 in 0.765s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:51 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 1G Jul 07 15:14:51 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Acquiring lock "cinder-8098bc98-7f59-4f0f-912b-d8a707fbf86a-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Lock "cinder-8098bc98-7f59-4f0f-912b-d8a707fbf86a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Acquiring lock "cinder-quobyte-8098bc98-7f59-4f0f-912b-d8a707fbf86a" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Lock "cinder-quobyte-8098bc98-7f59-4f0f-912b-d8a707fbf86a" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[509bbb52-0a39-4874-aaf4-12b714bd9629]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "cinder-edbbab88-cf1b-43ae-9e24-9efde8511594-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-edbbab88-cf1b-43ae-9e24-9efde8511594-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "cinder-quobyte-edbbab88-cf1b-43ae-9e24-9efde8511594" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-quobyte-edbbab88-cf1b-43ae-9e24-9efde8511594" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cbae69-dbd5-448e-9ce2-e8c271ba0a4d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:51 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a Jul 07 15:14:51 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:51 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 Jul 07 15:14:51 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:52 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 1G" returned: 0 in 0.933s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:52 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:14:52 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:52 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a" returned: 0 in 0.835s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:52 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a Jul 07 15:14:52 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:52 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594" returned: 0 in 0.813s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:52 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594 Jul 07 15:14:52 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:52 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:52 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 is being set with open permissions: ugo+rw Jul 07 15:14:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:52 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:14:52 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:53 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8098bc98-7f59-4f0f-912b-d8a707fbf86a" returned: 0 in 0.759s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Lock "cinder-quobyte-8098bc98-7f59-4f0f-912b-d8a707fbf86a" released by "delete_volume" :: held 1.672s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:53 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-edbbab88-cf1b-43ae-9e24-9efde8511594" returned: 0 in 0.740s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Created reservations ['673dd27f-f050-426d-9a60-8be1d92ba82d', 'c2fa80cb-4334-40bb-9563-e47d8e51f816', 'd1a7c6b8-13f4-4e73-91dc-b02583d29a06', '45e00692-f4e1-4390-8f77-90330e934124'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-quobyte-edbbab88-cf1b-43ae-9e24-9efde8511594" released by "delete_volume" :: held 1.593s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Created reservations ['8de1c643-3861-418f-b714-97b620a1d0ea', '0f0c27bd-0d5e-4ed8-9b8b-065bdf4e7611', '793d38fb-3952-481b-9a07-de7b2c3a4070', 'e1337690-3bd4-47b4-9462-a8c7c27b124e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:53 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:53 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:53 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:53 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:53 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.869s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:53 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.info Jul 07 15:14:53 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Flow 'volume_create_manager' (448353f1-3d91-4b38-bb7a-4c152bd83951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912f8bc7-3753-4fcd-bedd-7211c4ee27ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "cinder-f6628ec4-9537-42aa-aa08-448c2e9c8c35-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912f8bc7-3753-4fcd-bedd-7211c4ee27ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-473408662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcc6a8-30e9-4d56-a8d1-8a2e00afd411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a065e1bac4a54dbc83a6ee8b4c68a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:54Z,use_quota=True,user_id='66a0d23373b24cb985f2f966c31afaac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2d8fe2-f24a-4f15-86c3-0c2d23ace3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2d8fe2-f24a-4f15-86c3-0c2d23ace3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab1bef2-d79c-4122-aba2-5e604f91c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab1bef2-d79c-4122-aba2-5e604f91c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bcc6a8-30e9-4d56-a8d1-8a2e00afd411', 'volume_name': 'volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5f979-77d4-4ffb-b2eb-415c0dda96b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee5f979-77d4-4ffb-b2eb-415c0dda96b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93428f93-ea1b-483f-9f07-9a0cd6774d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:14:54 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Volume 96bcc6a8-30e9-4d56-a8d1-8a2e00afd411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411', 'volume_size': 1} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-f6628ec4-9537-42aa-aa08-448c2e9c8c35-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "cinder-quobyte-f6628ec4-9537-42aa-aa08-448c2e9c8c35" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-quobyte-f6628ec4-9537-42aa-aa08-448c2e9c8c35" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a7bf51-c3c1-43ee-a940-aa4ca23ef78a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:54 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.917s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Deleted volume successfully. Jul 07 15:14:54 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.008s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Deleted volume successfully. Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ed1815a5-5ac4-45c7-8c04-b155aa369d32 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-edbbab88-cf1b-43ae-9e24-9efde8511594-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:54 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 Jul 07 15:14:54 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e422f026-5faa-4dcc-a99c-6fb3d0d5c049 tempest-VolumesListAdminTestJSON-750606456 None] Lock "cinder-8098bc98-7f59-4f0f-912b-d8a707fbf86a-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:54 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.info" returned: 0 in 0.752s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:54 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.info is being set with open permissions: ugo+rw Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:54 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.info Jul 07 15:14:54 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:54 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:54 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35 Jul 07 15:14:54 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:55 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.info" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.960s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.871s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Creating offline snapshot ba7285a3-b5b1-4b56-a641-6f5eca429cbb of volume 2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:14:55 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-cbad2dcb-394f-46cd-a1b2-cd4e9024ee3f tempest-SnapshotsActionsTest-1408577742 None] Create snapshot completed successfully Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a72031c-7e23-4fd6-a82f-465d20ffa5e6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:55 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c Jul 07 15:14:55 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:55 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f6628ec4-9537-42aa-aa08-448c2e9c8c35" returned: 0 in 0.668s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-quobyte-f6628ec4-9537-42aa-aa08-448c2e9c8c35" released by "delete_volume" :: held 1.481s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Created reservations ['4d5317dc-c31b-4f6c-a556-4600fde969da', 'fa8b9e4d-c0b3-4a9b-b6e3-5d25a48cf542', '71a6a9a7-87be-4243-a4ee-657dc5488c80', '91bb7fad-54e3-4a01-8ce7-0aadbefdf38a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:55 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:55 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:56 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c" returned: 0 in 0.773s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:56 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb 1G Jul 07 15:14:56 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "cinder-d2f91682-cf93-4255-af29-dad8ad41667a-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-d2f91682-cf93-4255-af29-dad8ad41667a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "cinder-quobyte-d2f91682-cf93-4255-af29-dad8ad41667a" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:14:56 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.687s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-quobyte-d2f91682-cf93-4255-af29-dad8ad41667a" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:14:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Deleted volume successfully. Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aae0e6aa-fa3c-47f4-94c2-691d2a30c887 tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-f6628ec4-9537-42aa-aa08-448c2e9c8c35-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[107690ad-6c2b-48c0-b9e4-a4074a39d2d4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:56 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a Jul 07 15:14:56 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:56 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb 1G" returned: 0 in 0.898s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2847c6ce-913c-4315-ade8-64360a2ea85c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:56 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2847c6ce-913c-4315-ade8-64360a2ea85c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb Jul 07 15:14:56 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:57 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a" returned: 0 in 0.803s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:57 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a Jul 07 15:14:57 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:57 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2847c6ce-913c-4315-ade8-64360a2ea85c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb" returned: 0 in 0.692s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:57 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb is being set with open permissions: ugo+rw Jul 07 15:14:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:57 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb Jul 07 15:14:57 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:57 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d2f91682-cf93-4255-af29-dad8ad41667a" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-quobyte-d2f91682-cf93-4255-af29-dad8ad41667a" released by "delete_volume" :: held 1.542s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Created reservations ['7e85e64b-a52e-4f5f-9b71-3174ad42d78b', 'd81a21ef-42e9-4809-a49d-f08f97f3042f', '80098517-8a0a-43cc-9025-59ccc82c1781', 'e8c4cb47-f855-4c32-8b7d-f6d947ef2a97'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:58 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:14:58 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:58 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb" returned: 0 in 0.633s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:58 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.info Jul 07 15:14:58 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:58 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:14:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Deleted volume successfully. Jul 07 15:14:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff99ee1f-b4fe-442f-ba35-10b416a1b26d tempest-VolumesListAdminTestJSON-1406874277 None] Lock "cinder-d2f91682-cf93-4255-af29-dad8ad41667a-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:14:59 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.info" returned: 0 in 0.714s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:59 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.info is being set with open permissions: ugo+rw Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:59 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.info Jul 07 15:14:59 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:59 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.info" returned: 0 in 0.667s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.475s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.679s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-473408662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcc6a8-30e9-4d56-a8d1-8a2e00afd411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a065e1bac4a54dbc83a6ee8b4c68a667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:14:54Z,use_quota=True,user_id='66a0d23373b24cb985f2f966c31afaac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Creating volume 96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:14:59 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:14:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:14:59 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 1073741824 Jul 07 15:14:59 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:14:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5d644cf2-adee-4f1d-9613-59240da42834 tempest-VolumesSnapshotTestJSON-540025096 None] Create snapshot completed successfully Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:00 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:00 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (37dec8f2-00bd-412c-ae1f-6d48b5b93a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24f4972-7323-4fc2-bc52-dc347d13a002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24f4972-7323-4fc2-bc52-dc347d13a002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-832120704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ab5da0-18cb-4bc6-87e2-287da60d592b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ba7285a3-b5b1-4b56-a641-6f5eca429cbb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:00Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1238da-3fb4-457a-a781-86ef30c2c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1238da-3fb4-457a-a781-86ef30c2c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1785e3ef-ea44-4aa9-9f35-f4447285d1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1785e3ef-ea44-4aa9-9f35-f4447285d1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42ab5da0-18cb-4bc6-87e2-287da60d592b', 'volume_name': 'volume-42ab5da0-18cb-4bc6-87e2-287da60d592b', 'volume_size': 2, 'snapshot_id': 'ba7285a3-b5b1-4b56-a641-6f5eca429cbb'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d03844-f991-45e7-9c73-834d1c2a5052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d03844-f991-45e7-9c73-834d1c2a5052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d51e3-8cd9-4dc3-b2d3-f0675fc03b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:00 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Volume 42ab5da0-18cb-4bc6-87e2-287da60d592b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42ab5da0-18cb-4bc6-87e2-287da60d592b', 'volume_size': 2, 'snapshot_id': 'ba7285a3-b5b1-4b56-a641-6f5eca429cbb'} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:00 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 1073741824" returned: 0 in 1.038s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:00 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 Jul 07 15:15:00 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:00 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.847s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:15:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:15:01 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411" returned: 0 in 0.730s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.747s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Creating offline snapshot 27f54625-f7bb-4db0-a943-80f74d8b6a02 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93428f93-ea1b-483f-9f07-9a0cd6774d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388e8bd6-8e62-4b2b-947e-c04241815cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad024907-63c0-4893-8838-a7318dd17c72]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:01 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Volume volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 (96bcc6a8-30e9-4d56-a8d1-8a2e00afd411): created successfully Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388e8bd6-8e62-4b2b-947e-c04241815cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Flow 'volume_create_manager' (448353f1-3d91-4b38-bb7a-4c152bd83951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-901312d7-ce3f-4db9-9506-c14f5d002e82 tempest-AttachVolumeTestJSON-1298375289 None] Created volume successfully. Jul 07 15:15:01 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:01 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:02 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:02 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 1G Jul 07 15:15:02 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:03 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 1G" returned: 0 in 0.851s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:03 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 Jul 07 15:15:03 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Flow 'volume_create_manager' (90bda350-9b9e-4e17-bb24-03129945b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbb24ad-0611-46a9-883c-d3870933faca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbb24ad-0611-46a9-883c-d3870933faca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-22255980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d04052-405a-4366-b7c1-64c36ff5d924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005c4e2eeec34020a5f1f77b8efb006d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:04Z,use_quota=True,user_id='19bfb0454e584eca98c26bff32a3771b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3718c7cd-216f-4edb-beeb-ffeb686262d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3718c7cd-216f-4edb-beeb-ffeb686262d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dd39dd-4992-43ca-89db-213513f8e91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dd39dd-4992-43ca-89db-213513f8e91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d04052-405a-4366-b7c1-64c36ff5d924', 'volume_name': 'volume-e5d04052-405a-4366-b7c1-64c36ff5d924', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84aa7329-199f-443b-9c60-a4e3e27ecbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84aa7329-199f-443b-9c60-a4e3e27ecbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ec9e57-5e60-444b-8894-1ce487dc00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:03 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Volume e5d04052-405a-4366-b7c1-64c36ff5d924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d04052-405a-4366-b7c1-64c36ff5d924', 'volume_size': 1} Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:03 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02" returned: 0 in 0.737s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:03 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 is being set with open permissions: ugo+rw Jul 07 15:15:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:04 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 Jul 07 15:15:04 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:04 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.143s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.035s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-ba7285a3-b5b1-4b56-a641-6f5eca429cbb-42ab5da0-18cb-4bc6-87e2-287da60d592b" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-ba7285a3-b5b1-4b56-a641-6f5eca429cbb-42ab5da0-18cb-4bc6-87e2-287da60d592b" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Creating volume 42ab5da0-18cb-4bc6-87e2-287da60d592b from snapshot ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-42ab5da0-18cb-4bc6-87e2-287da60d592b" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:04 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8f9dbe54-d0e6-4610-9cb3-5bd7c127b180 tempest-SnapshotsActionsTest-1408577742 None] Create snapshot completed successfully Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-42ab5da0-18cb-4bc6-87e2-287da60d592b" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] snapshot: ba7285a3-b5b1-4b56-a641-6f5eca429cbb, volume: 42ab5da0-18cb-4bc6-87e2-287da60d592b, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15efdcb-c816-4ef0-9c17-9290cc0d653f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:04 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb Jul 07 15:15:04 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-27f54625-f7bb-4db0-a943-80f74d8b6a02-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-27f54625-f7bb-4db0-a943-80f74d8b6a02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-27f54625-f7bb-4db0-a943-80f74d8b6a02" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-27f54625-f7bb-4db0-a943-80f74d8b6a02" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Deleting offline snapshot 27f54625-f7bb-4db0-a943-80f74d8b6a02 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] snapshot_file for this snap is: volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ac5db-f086-46b4-8797-8873aa7049dc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:05 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 Jul 07 15:15:05 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-d483d141-87ab-4aed-b587-515254b5d8d0 req-4c4059d1-c4a1-4ba3-9451-e34d1655b9c5 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:05 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb" returned: 0 in 0.820s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2847c6ce-913c-4315-ade8-64360a2ea85c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[81171d4b-a30a-435a-83d7-86116626a9ac]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:05 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c Jul 07 15:15:05 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:06 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02" returned: 0 in 0.772s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f66ec1-c351-4202-ac63-ebb8444b3b15]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:06 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:06 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:06 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c" returned: 0 in 0.804s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:06 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b Jul 07 15:15:06 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:06 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.755s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:06 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 Jul 07 15:15:06 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:08 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02" returned: 0 in 1.658s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:08 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02 Jul 07 15:15:08 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:10 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.27f54625-f7bb-4db0-a943-80f74d8b6a02" returned: 0 in 1.820s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-27f54625-f7bb-4db0-a943-80f74d8b6a02" released by "_delete_snapshot" :: held 5.142s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" released by "delete_snapshot" :: held 5.177s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:10 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Created reservations ['edc66c0a-241b-4f91-a573-eecada6d8aa6', '23c3b3d2-c104-430b-8a5f-2bef6c8f5970', '94de5e0f-6bc2-48f6-b4cb-df4a17cb934f', '4c5d60c8-d110-40b3-b9a5-ebaf0905f3a0'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Delete snapshot completed successfully. Jul 07 15:15:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-382e9f4d-1c41-422c-890a-0bcd0de860aa tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-27f54625-f7bb-4db0-a943-80f74d8b6a02-delete_snapshot" released by "delete_snapshot" :: held 5.533s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:11 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b" returned: 0 in 5.025s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c068d70-5de8-44b2-b8f9-a2d34f7c9471]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:11 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c Jul 07 15:15:11 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:12 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c" returned: 0 in 0.913s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:12 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:15:12 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Converted 1024.00 MB image at 203.75 MB/s Jul 07 15:15:12 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b is being set with open permissions: ugo+rw Jul 07 15:15:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:12 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b Jul 07 15:15:12 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:13 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b" returned: 0 in 0.620s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-42ab5da0-18cb-4bc6-87e2-287da60d592b" released by "_copy_volume_from_snapshot" :: held 8.283s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-ba7285a3-b5b1-4b56-a641-6f5eca429cbb-42ab5da0-18cb-4bc6-87e2-287da60d592b" released by "_create_volume_from_snapshot" :: held 8.332s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.367s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.382s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-22255980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d04052-405a-4366-b7c1-64c36ff5d924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005c4e2eeec34020a5f1f77b8efb006d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:04Z,use_quota=True,user_id='19bfb0454e584eca98c26bff32a3771b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Creating volume e5d04052-405a-4366-b7c1-64c36ff5d924 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:15:13 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:13 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 1073741824 Jul 07 15:15:13 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d51e3-8cd9-4dc3-b2d3-f0675fc03b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ab5da0-18cb-4bc6-87e2-287da60d592b', 'volume_size': 2, 'snapshot_id': 'ba7285a3-b5b1-4b56-a641-6f5eca429cbb'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d51a69-05d7-43a6-ac87-f9c6736b7539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:13 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Volume volume-42ab5da0-18cb-4bc6-87e2-287da60d592b (42ab5da0-18cb-4bc6-87e2-287da60d592b): created successfully Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d51a69-05d7-43a6-ac87-f9c6736b7539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (37dec8f2-00bd-412c-ae1f-6d48b5b93a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-293ba738-ca6f-4965-bcae-4d0a07f1d2ef tempest-VolumesSnapshotTestJSON-540025096 None] Created volume successfully. Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-42ab5da0-18cb-4bc6-87e2-287da60d592b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-42ab5da0-18cb-4bc6-87e2-287da60d592b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-42ab5da0-18cb-4bc6-87e2-287da60d592b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-42ab5da0-18cb-4bc6-87e2-287da60d592b" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[303312e7-339d-4fb6-9f99-b517c430eee8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:13 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 1073741824" returned: 0 in 0.856s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:13 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 Jul 07 15:15:13 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:14 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b Jul 07 15:15:14 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:14 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924" returned: 0 in 0.626s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-d483d141-87ab-4aed-b587-515254b5d8d0 req-4c4059d1-c4a1-4ba3-9451-e34d1655b9c5 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.086s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ec9e57-5e60-444b-8894-1ce487dc00e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d04052-405a-4366-b7c1-64c36ff5d924', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0698c386-e40a-4940-98a4-71ce9d43cefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5275fb34-bf07-426b-a58e-df6ded09c3d3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-d483d141-87ab-4aed-b587-515254b5d8d0 req-4c4059d1-c4a1-4ba3-9451-e34d1655b9c5 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Volume volume-e5d04052-405a-4366-b7c1-64c36ff5d924 (e5d04052-405a-4366-b7c1-64c36ff5d924): created successfully Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0698c386-e40a-4940-98a4-71ce9d43cefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Flow 'volume_create_manager' (90bda350-9b9e-4e17-bb24-03129945b777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:14 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b" returned: 0 in 0.810s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:14 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-13086551-7297-44d7-99c1-b37463b40c9f tempest-AbsoluteLimitsTests-1666188745 None] Created volume successfully. Jul 07 15:15:14 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b Jul 07 15:15:14 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:14 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 Jul 07 15:15:14 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:15 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-42ab5da0-18cb-4bc6-87e2-287da60d592b" returned: 0 in 0.691s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:15 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-42ab5da0-18cb-4bc6-87e2-287da60d592b" released by "delete_volume" :: held 1.540s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-d483d141-87ab-4aed-b587-515254b5d8d0 req-4c4059d1-c4a1-4ba3-9451-e34d1655b9c5 tempest-AttachVolumeTestJSON-1298375289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411" returned: 0 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-d483d141-87ab-4aed-b587-515254b5d8d0 req-4c4059d1-c4a1-4ba3-9451-e34d1655b9c5 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.810s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.866s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Creating offline snapshot 7de7be22-dea8-48d2-b27e-b56ff71b6b31 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-d483d141-87ab-4aed-b587-515254b5d8d0 req-4c4059d1-c4a1-4ba3-9451-e34d1655b9c5 tempest-AttachVolumeTestJSON-1298375289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b5bce2b-25dc-49ac-96f3-005dde4c512b', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[50316835-ce39-4142-8de5-b08375ca9814]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['9b39ca6b-503b-4acc-8a8a-64b9015dc590', '4122520f-46c1-4fe0-be9e-1e2e5baa0b42', 'a536a6b8-5afe-46a8-bcd0-378c959adabe', '7d4a4059-d707-4df7-9266-566f3c8511f3'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-d483d141-87ab-4aed-b587-515254b5d8d0 req-4c4059d1-c4a1-4ba3-9451-e34d1655b9c5 tempest-AttachVolumeTestJSON-1298375289 None] attachment_update completed successfully. Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:15 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:15 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:15 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:15 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Acquiring lock "cinder-e5d04052-405a-4366-b7c1-64c36ff5d924-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Lock "cinder-e5d04052-405a-4366-b7c1-64c36ff5d924-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Acquiring lock "cinder-quobyte-e5d04052-405a-4366-b7c1-64c36ff5d924" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Lock "cinder-quobyte-e5d04052-405a-4366-b7c1-64c36ff5d924" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[30603524-7dea-463d-9cd2-7c3124bd3ec8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:16 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 Jul 07 15:15:16 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-ba7285a3-b5b1-4b56-a641-6f5eca429cbb-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-ba7285a3-b5b1-4b56-a641-6f5eca429cbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-2847c6ce-913c-4315-ade8-64360a2ea85c" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-2847c6ce-913c-4315-ade8-64360a2ea85c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-ba7285a3-b5b1-4b56-a641-6f5eca429cbb" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-ba7285a3-b5b1-4b56-a641-6f5eca429cbb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Deleting offline snapshot ba7285a3-b5b1-4b56-a641-6f5eca429cbb of volume 2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] snapshot_file for this snap is: volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d8f068-4dc7-41cc-89e1-eec61c58a09b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:16 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb Jul 07 15:15:16 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:16 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.696s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:16 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Deleted volume successfully. Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0ea0e33c-ec1d-4574-8ff1-5d378598aee7 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-42ab5da0-18cb-4bc6-87e2-287da60d592b-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:16 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 1.013s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:16 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 1G Jul 07 15:15:16 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:16 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924" returned: 0 in 0.921s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:16 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924 Jul 07 15:15:16 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:17 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb" returned: 0 in 0.883s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2847c6ce-913c-4315-ade8-64360a2ea85c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5be740f-17a2-4f7f-8d33-e515e0e82314]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:17 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c Jul 07 15:15:17 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:17 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 1G" returned: 0 in 0.895s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:17 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 Jul 07 15:15:17 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:17 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e5d04052-405a-4366-b7c1-64c36ff5d924" returned: 0 in 0.747s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Lock "cinder-quobyte-e5d04052-405a-4366-b7c1-64c36ff5d924" released by "delete_volume" :: held 1.717s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Created reservations ['ee2e8f43-1b98-45bf-898a-b4c626dfaf98', '7109935b-1c30-47ab-9f73-7169de819de6', '9f9c84e5-7738-4fba-a038-52a3a2e49ab9', '087bdc55-43d3-4790-8de8-9da423728bf5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:17 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:17 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:17 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c" returned: 0 in 0.824s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:18 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb Jul 07 15:15:18 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:18 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31" returned: 0 in 0.790s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:18 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 is being set with open permissions: ugo+rw Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:18 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 Jul 07 15:15:18 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:18 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.799s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Deleted volume successfully. Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7fdc4c07-a192-47a6-b5c8-3bd9382cf01e tempest-AbsoluteLimitsTests-1666188745 None] Lock "cinder-e5d04052-405a-4366-b7c1-64c36ff5d924-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:18 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb" returned: 0 in 0.908s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:18 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb Jul 07 15:15:18 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:18 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31" returned: 0 in 0.738s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.625s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d7cfa4f0-e495-4755-a8f6-c02448a1fc27 tempest-SnapshotsActionsTest-1408577742 None] Create snapshot completed successfully Jul 07 15:15:19 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c.ba7285a3-b5b1-4b56-a641-6f5eca429cbb" returned: 0 in 0.764s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-ba7285a3-b5b1-4b56-a641-6f5eca429cbb" released by "_delete_snapshot" :: held 3.518s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-2847c6ce-913c-4315-ade8-64360a2ea85c" released by "delete_snapshot" :: held 3.553s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:19 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['ee96c349-06d3-4469-8cec-c2561666dd4d', 'c1e9fa06-973e-4336-b91e-a5c0a6b13df1', '68931d66-45e7-4cf6-b5eb-673eefb800e0', '3e7f81f2-9647-434f-ac18-77ee030e22a6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Delete snapshot completed successfully. Jul 07 15:15:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2d34d36a-f04d-4c18-8c0b-7f8a871d8218 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-ba7285a3-b5b1-4b56-a641-6f5eca429cbb-delete_snapshot" released by "delete_snapshot" :: held 3.728s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-7de7be22-dea8-48d2-b27e-b56ff71b6b31-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-7de7be22-dea8-48d2-b27e-b56ff71b6b31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-7de7be22-dea8-48d2-b27e-b56ff71b6b31" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7de7be22-dea8-48d2-b27e-b56ff71b6b31" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Deleting offline snapshot 7de7be22-dea8-48d2-b27e-b56ff71b6b31 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] snapshot_file for this snap is: volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dfb753-c3bc-46db-a0a9-258b728e3b1a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:20 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 Jul 07 15:15:20 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-2847c6ce-913c-4315-ade8-64360a2ea85c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-2847c6ce-913c-4315-ade8-64360a2ea85c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-2847c6ce-913c-4315-ade8-64360a2ea85c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-2847c6ce-913c-4315-ade8-64360a2ea85c" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[277c2e83-c0cf-4ab2-bdd1-6730d694446f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:20 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c Jul 07 15:15:20 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:21 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31" returned: 0 in 0.964s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0baee3-ad8b-4288-88c9-d05122dbd2e0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:21 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:21 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:21 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c" returned: 0 in 0.894s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:21 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c Jul 07 15:15:21 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:22 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.854s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:22 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 Jul 07 15:15:22 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:22 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2847c6ce-913c-4315-ade8-64360a2ea85c" returned: 0 in 0.749s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-2847c6ce-913c-4315-ade8-64360a2ea85c" released by "delete_volume" :: held 1.753s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=131,cinder:UPDATE=128,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=129,cinder:INSERT=33,cinder:DELETE=12,cinder:SELECT=119 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['1cdef6e2-0fa3-4b40-8263-48f0bfbfa9ff', '8994f380-e85d-4248-a9a4-25b213911d3a', 'bf27914e-2159-469d-bab4-95d55203970c', 'cf47a457-4d6e-4b9d-8252-685df7dbd486'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:22 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:22 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:22 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-753be9d9-1946-4a11-bf58-9142e97ff785 req-2cfa9064-8dda-41a8-9a76-c5739db10905 tempest-AttachVolumeTestJSON-1298375289 None] Terminate volume connection completed successfully. Jul 07 15:15:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-753be9d9-1946-4a11-bf58-9142e97ff785 req-2cfa9064-8dda-41a8-9a76-c5739db10905 tempest-AttachVolumeTestJSON-1298375289 None] Deleting attachment 27445ba2-da18-43ee-9411-de7dc5ddc876. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:15:23 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31" returned: 0 in 1.077s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:23 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31 Jul 07 15:15:23 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (d73ac1ca-0479-418e-9b1e-a9248ada10e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d8bbc-e9dd-49de-a02b-dc38871bfe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:23 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.929s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d8bbc-e9dd-49de-a02b-dc38871bfe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1703277971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5258fd-0732-4230-8677-c207d5d88560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:23Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f9486-9021-4dc7-bb1d-23fa44ecf20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f9486-9021-4dc7-bb1d-23fa44ecf20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1479ed-4901-4b34-95aa-19352105fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1479ed-4901-4b34-95aa-19352105fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c5258fd-0732-4230-8677-c207d5d88560', 'volume_name': 'volume-3c5258fd-0732-4230-8677-c207d5d88560', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e35574-4a08-4821-8d98-14f600e96f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e35574-4a08-4821-8d98-14f600e96f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bc7492-c5bc-45bb-b0ad-f53f4d7d6454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Volume 3c5258fd-0732-4230-8677-c207d5d88560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c5258fd-0732-4230-8677-c207d5d88560', 'volume_size': 1} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1703277971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5258fd-0732-4230-8677-c207d5d88560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:23Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Creating volume 3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:15:23 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Deleted volume successfully. Jul 07 15:15:23 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 1073741824 Jul 07 15:15:23 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-47a3b931-89e8-49c1-b2ed-c812f0c23dfc tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-2847c6ce-913c-4315-ade8-64360a2ea85c-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:24 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.7de7be22-dea8-48d2-b27e-b56ff71b6b31" returned: 0 in 0.821s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7de7be22-dea8-48d2-b27e-b56ff71b6b31" released by "_delete_snapshot" :: held 3.864s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" released by "delete_snapshot" :: held 3.890s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Created reservations ['f8fd7f7a-9c4f-45cc-833d-b38e8be745c7', 'fbe1127c-0bed-4cdd-960a-d80857b92e41', 'e788f423-5caa-4fd0-a4b0-0ff3fb17c60a', '8b06da61-f721-476b-a85e-d6888bef7c9a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Delete snapshot completed successfully. Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6d22ae7d-d053-4784-b2e0-b242b9dfcdad tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-7de7be22-dea8-48d2-b27e-b56ff71b6b31-delete_snapshot" released by "delete_snapshot" :: held 4.043s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:24 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 1073741824" returned: 0 in 1.046s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:24 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 Jul 07 15:15:24 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Flow 'volume_create_manager' (d6d5de07-4b49-4dc5-b19f-5acb38770221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6933b57f-1263-4928-abbc-7a01ebc592ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6933b57f-1263-4928-abbc-7a01ebc592ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-628206589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e721272e-7bb6-414a-8c6a-2c8ca45574ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940aa372cc55468188ae170fe4f1d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:25Z,use_quota=True,user_id='dc0d61aac468427db3d7bee3108a89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146c49c8-d502-49ba-b72f-22282a854f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146c49c8-d502-49ba-b72f-22282a854f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25a0204-8adc-4520-9cc0-edd5a715971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25a0204-8adc-4520-9cc0-edd5a715971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e721272e-7bb6-414a-8c6a-2c8ca45574ff', 'volume_name': 'volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cbd3b2-060a-4d71-8aaa-4d11e503822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cbd3b2-060a-4d71-8aaa-4d11e503822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d2fed4-c4c9-43c4-8751-b3afeb78a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Volume e721272e-7bb6-414a-8c6a-2c8ca45574ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff', 'volume_size': 1} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-d697408d-3a34-4250-a21d-5a2dd2c0ee17 req-17c035e4-a370-43f4-bada-13ea181c8707 tempest-AttachVolumeTestJSON-1298375289 None] Terminate volume connection completed successfully. Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-d697408d-3a34-4250-a21d-5a2dd2c0ee17 req-17c035e4-a370-43f4-bada-13ea181c8707 tempest-AttachVolumeTestJSON-1298375289 None] Deleting attachment 8b5bce2b-25dc-49ac-96f3-005dde4c512b. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:15:25 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560" returned: 0 in 0.716s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-628206589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e721272e-7bb6-414a-8c6a-2c8ca45574ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940aa372cc55468188ae170fe4f1d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:25Z,use_quota=True,user_id='dc0d61aac468427db3d7bee3108a89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Creating volume e721272e-7bb6-414a-8c6a-2c8ca45574ff {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:15:25 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bc7492-c5bc-45bb-b0ad-f53f4d7d6454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c5258fd-0732-4230-8677-c207d5d88560', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea8a543-0ce0-41f6-8192-f26157fc39fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:25 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff 1073741824 Jul 07 15:15:25 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Volume volume-3c5258fd-0732-4230-8677-c207d5d88560 (3c5258fd-0732-4230-8677-c207d5d88560): created successfully Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea8a543-0ce0-41f6-8192-f26157fc39fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (d73ac1ca-0479-418e-9b1e-a9248ada10e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e252512b-e142-4a88-ae29-a14c01fe4e87 tempest-VolumesSnapshotTestJSON-540025096 None] Created volume successfully. Jul 07 15:15:26 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff 1073741824" returned: 0 in 0.843s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:26 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff Jul 07 15:15:26 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:26 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff" returned: 0 in 0.673s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d2fed4-c4c9-43c4-8751-b3afeb78a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a22fef-3167-4d7a-86ec-cff9d50b300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Creating offline snapshot a885d843-64b3-4bac-b68e-14c557c53600 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:15:26 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Volume volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff (e721272e-7bb6-414a-8c6a-2c8ca45574ff): created successfully Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a22fef-3167-4d7a-86ec-cff9d50b300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Flow 'volume_create_manager' (d6d5de07-4b49-4dc5-b19f-5acb38770221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f3aa3-389c-44b5-9a1f-ede0387eef65]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4351d560-9888-484c-83fa-a9cde51b2953 tempest-VolumesTransfersV355Test-1683171122 None] Created volume successfully. Jul 07 15:15:27 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:27 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:27 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.789s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:27 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 1G Jul 07 15:15:27 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-11d6a12c-6a0b-458e-9008-07a79ac81dbd tempest-VolumesTransfersV355Test-1407085516 None] Transfer volume completed successfully. Jul 07 15:15:28 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 1G" returned: 0 in 0.866s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:28 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 Jul 07 15:15:28 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:29 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600" returned: 0 in 0.764s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:29 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 is being set with open permissions: ugo+rw Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:29 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 Jul 07 15:15:29 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Acquiring lock "cinder-e721272e-7bb6-414a-8c6a-2c8ca45574ff-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-e721272e-7bb6-414a-8c6a-2c8ca45574ff-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Acquiring lock "cinder-quobyte-e721272e-7bb6-414a-8c6a-2c8ca45574ff" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-quobyte-e721272e-7bb6-414a-8c6a-2c8ca45574ff" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02148e4e-f0ac-431b-8b69-5f7a2f888ba7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:29 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff Jul 07 15:15:29 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:30 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600" returned: 0 in 0.876s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.438s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.636s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Creating offline snapshot 7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 of volume 3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:15:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-12db7c2a-39a8-4385-9c1b-cd36f221ea3b tempest-SnapshotsActionsTest-1408577742 None] Create snapshot completed successfully Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c824966-58e0-4aae-be82-0c881fc48bcf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:30 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 Jul 07 15:15:30 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:30 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff" returned: 0 in 0.862s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:30 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff Jul 07 15:15:30 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:31 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560" returned: 0 in 0.888s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:31 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:31 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 1G Jul 07 15:15:31 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-a885d843-64b3-4bac-b68e-14c557c53600-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e721272e-7bb6-414a-8c6a-2c8ca45574ff" returned: 0 in 0.737s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-quobyte-e721272e-7bb6-414a-8c6a-2c8ca45574ff" released by "delete_volume" :: held 1.657s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-a885d843-64b3-4bac-b68e-14c557c53600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-a885d843-64b3-4bac-b68e-14c557c53600" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-a885d843-64b3-4bac-b68e-14c557c53600" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Deleting offline snapshot a885d843-64b3-4bac-b68e-14c557c53600 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] snapshot_file for this snap is: volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edecc36-1459-4f4c-91cd-9f8292bd627b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Created reservations ['ee0ef15f-ba88-4a5b-92fb-bc93d2483ccc', '72e0882c-4799-458c-ac39-d08295d6dee7', 'b374d322-eacc-483e-9fc9-b042b8eb61df', '165e2783-50ad-42ca-a612-92291c7f71f2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:31 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 Jul 07 15:15:31 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:31 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:31 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:32 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.891s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:32 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Deleted volume successfully. Jul 07 15:15:32 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600" returned: 0 in 1.007s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:32 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Flow 'volume_create_manager' (3dceea49-917b-4977-ad20-8ad457faf491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cd70b8-9fa6-4974-8441-983bfb11bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5028829-fe01-4090-8f69-567a3477caba]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 1G" returned: 0 in 1.230s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5258fd-0732-4230-8677-c207d5d88560 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cd70b8-9fa6-4974-8441-983bfb11bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-623457931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757abd70-3df8-4f0c-8951-022aa879100d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940aa372cc55468188ae170fe4f1d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:32Z,use_quota=True,user_id='dc0d61aac468427db3d7bee3108a89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78950bc4-f23c-46f7-b633-3e784637e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:32 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5258fd-0732-4230-8677-c207d5d88560 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 Jul 07 15:15:32 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78950bc4-f23c-46f7-b633-3e784637e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237484bc-0e12-4b39-bad3-04abe4eebc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237484bc-0e12-4b39-bad3-04abe4eebc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757abd70-3df8-4f0c-8951-022aa879100d', 'volume_name': 'volume-757abd70-3df8-4f0c-8951-022aa879100d', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df73b4e-7a26-46cd-9c8b-13cce37483a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df73b4e-7a26-46cd-9c8b-13cce37483a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aacc6cb-d14b-4738-8f13-6e27c3e8adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Volume 757abd70-3df8-4f0c-8951-022aa879100d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757abd70-3df8-4f0c-8951-022aa879100d', 'volume_size': 1} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e3b82470-b401-4a31-bf3f-ecad742b636c tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-e721272e-7bb6-414a-8c6a-2c8ca45574ff-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:32 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:32 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:33 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5258fd-0732-4230-8677-c207d5d88560 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" returned: 0 in 0.728s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:33 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 is being set with open permissions: ugo+rw Jul 07 15:15:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:33 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 Jul 07 15:15:33 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:33 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.785s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:33 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 Jul 07 15:15:33 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:33 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:33 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.info Jul 07 15:15:33 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:34 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600" returned: 0 in 0.820s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:34 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600 Jul 07 15:15:34 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:34 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.info" returned: 0 in 0.671s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:34 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.info is being set with open permissions: ugo+rw Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:34 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.info Jul 07 15:15:34 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:34 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a885d843-64b3-4bac-b68e-14c557c53600" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-a885d843-64b3-4bac-b68e-14c557c53600" released by "_delete_snapshot" :: held 3.386s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" released by "delete_snapshot" :: held 3.410s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Created reservations ['721d1e39-bc56-40cb-8c99-9898e88f1b50', '73e0926c-3f07-43f2-957a-3487639d86fd', '3a889b99-fd7e-4218-b5b8-3f28d017c16a', 'fc67ece9-f7e0-4980-a142-eba68281c539'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Delete snapshot completed successfully. Jul 07 15:15:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c0f23f44-7cd0-4fd7-8b51-003b1c19fa94 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-a885d843-64b3-4bac-b68e-14c557c53600-delete_snapshot" released by "delete_snapshot" :: held 3.574s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:35 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.info" returned: 0 in 0.666s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.975s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.753s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-623457931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757abd70-3df8-4f0c-8951-022aa879100d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940aa372cc55468188ae170fe4f1d7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:32Z,use_quota=True,user_id='dc0d61aac468427db3d7bee3108a89af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Creating volume 757abd70-3df8-4f0c-8951-022aa879100d {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:15:35 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:35 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d 1073741824 Jul 07 15:15:35 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4d39da31-eccb-4f94-bebd-efb9e53ebedb tempest-VolumesSnapshotTestJSON-540025096 None] Create snapshot completed successfully Jul 07 15:15:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "cinder-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "cinder-quobyte-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:36 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d 1073741824" returned: 0 in 0.998s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-quobyte-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f135e0-fcd2-4e5c-b961-515c3b75a20f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:36 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d Jul 07 15:15:36 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:36 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 Jul 07 15:15:36 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (b860b822-3b88-4073-b13e-648f28c3d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811bb25e-9464-4df9-929f-b0d9513c4319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811bb25e-9464-4df9-929f-b0d9513c4319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1503694505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be882c6-3032-4a0d-95e5-f1f7adde3670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e5b00b75104eb9913414b1e7e62700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a4e3942-9dbb-43a7-8bbd-65fc80d45e74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:37Z,use_quota=True,user_id='157df8b68154451f9168c929d2a7b85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7233a8e4-a44a-4ffa-91d0-964ad19db6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7233a8e4-a44a-4ffa-91d0-964ad19db6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a354373-f474-42ba-af93-e7bbefc92444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a354373-f474-42ba-af93-e7bbefc92444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4be882c6-3032-4a0d-95e5-f1f7adde3670', 'volume_name': 'volume-4be882c6-3032-4a0d-95e5-f1f7adde3670', 'volume_size': 1, 'snapshot_id': '7a4e3942-9dbb-43a7-8bbd-65fc80d45e74'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03093c18-fae9-444c-9410-4e7b86924eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03093c18-fae9-444c-9410-4e7b86924eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379027f9-cbd0-4484-828b-159e5fd8f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:36 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Volume 4be882c6-3032-4a0d-95e5-f1f7adde3670: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4be882c6-3032-4a0d-95e5-f1f7adde3670', 'volume_size': 1, 'snapshot_id': '7a4e3942-9dbb-43a7-8bbd-65fc80d45e74'} Jul 07 15:15:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:37 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d" returned: 0 in 0.723s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.217s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aacc6cb-d14b-4738-8f13-6e27c3e8adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757abd70-3df8-4f0c-8951-022aa879100d', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6b8a8a-06b0-4a9f-9cd9-e4a796cfbccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Creating offline snapshot cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:15:37 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Volume volume-757abd70-3df8-4f0c-8951-022aa879100d (757abd70-3df8-4f0c-8951-022aa879100d): created successfully Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6b8a8a-06b0-4a9f-9cd9-e4a796cfbccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Flow 'volume_create_manager' (3dceea49-917b-4977-ad20-8ad457faf491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6627e61-9565-452c-915d-059336149366]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a171026f-bdd3-4ba5-909e-e2877180db83 tempest-VolumesTransfersV355Test-1683171122 None] Created volume successfully. Jul 07 15:15:37 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411" returned: 0 in 0.881s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:37 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411 Jul 07 15:15:37 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:37 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:37 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:37 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411" returned: 0 in 0.710s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-quobyte-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411" released by "delete_volume" :: held 1.650s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:37 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Created reservations ['55cae73f-7e61-4f06-885c-e101746ef591', 'b7787878-61c3-4aec-9526-077eeed08a6a', 'be7e9ad8-db65-4aa7-9808-14ccb6eaae59', '580b25da-a0df-4c5f-a941-38f345dba942'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:37 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Acquiring lock "cinder-757abd70-3df8-4f0c-8951-022aa879100d-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:38 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 1G Jul 07 15:15:38 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-757abd70-3df8-4f0c-8951-022aa879100d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Acquiring lock "cinder-quobyte-757abd70-3df8-4f0c-8951-022aa879100d" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:38 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:38 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-quobyte-757abd70-3df8-4f0c-8951-022aa879100d" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0596d6-68ba-443a-8f43-8580981afafc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:38 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d Jul 07 15:15:38 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "cinder-5abef784-f8b7-418c-a376-303e036f0c87-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-5abef784-f8b7-418c-a376-303e036f0c87-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "cinder-quobyte-5abef784-f8b7-418c-a376-303e036f0c87" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-quobyte-5abef784-f8b7-418c-a376-303e036f0c87" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[142f0534-eb19-4d5e-b02d-2f6cb89695fb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:38 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 Jul 07 15:15:38 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:38 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.739s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Deleted volume successfully. Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1dc1e211-4213-48c2-9adc-9214c0c318e4 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-96bcc6a8-30e9-4d56-a8d1-8a2e00afd411-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:38 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 1G" returned: 0 in 0.949s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:38 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 Jul 07 15:15:38 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:39 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d" returned: 0 in 0.884s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:39 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d Jul 07 15:15:39 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:39 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87" returned: 0 in 0.857s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:39 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87 Jul 07 15:15:39 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:39 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" returned: 0 in 0.712s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:39 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 is being set with open permissions: ugo+rw Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:39 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 Jul 07 15:15:39 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:39 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-757abd70-3df8-4f0c-8951-022aa879100d" returned: 0 in 0.717s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-quobyte-757abd70-3df8-4f0c-8951-022aa879100d" released by "delete_volume" :: held 1.649s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Created reservations ['0c4fb06a-108f-4cdd-bdf1-b03c4449a543', 'cc4648cc-bdc0-44a5-b62c-d8977d83784c', '7479747d-1d03-4ce3-85e4-6ef69765f297', '6e7cb970-1c91-4d8f-a79d-6481ba433f89'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:39 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:39 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:40 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5abef784-f8b7-418c-a376-303e036f0c87" returned: 0 in 0.661s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-quobyte-5abef784-f8b7-418c-a376-303e036f0c87" released by "delete_volume" :: held 1.568s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Created reservations ['0341974b-b1c4-4b94-bc65-ce494c5c2d8c', 'bcb30daf-9035-42f3-89e8-949f9c36076f', '637d2708-9af4-407e-b188-1f262d12c4bf', 'aad267bc-1707-4f93-9c37-10b3ce831f0e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:40 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:40 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:40 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" returned: 0 in 0.754s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.402s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.617s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74-4be882c6-3032-4a0d-95e5-f1f7adde3670" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-20f0d9e6-c4d5-417a-a37d-2155bb9803ca tempest-SnapshotsActionsTest-1408577742 None] Create snapshot completed successfully Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74-4be882c6-3032-4a0d-95e5-f1f7adde3670" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Creating volume 4be882c6-3032-4a0d-95e5-f1f7adde3670 from snapshot 7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-4be882c6-3032-4a0d-95e5-f1f7adde3670" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-4be882c6-3032-4a0d-95e5-f1f7adde3670" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] snapshot: 7a4e3942-9dbb-43a7-8bbd-65fc80d45e74, volume: 4be882c6-3032-4a0d-95e5-f1f7adde3670, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f5679-16c3-4940-bc21-80e0784b5f94]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:40 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.846s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:40 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 Jul 07 15:15:40 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Deleted volume successfully. Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cb64061-6729-4c77-a3d5-5aa85b20a77a tempest-VolumesTransfersV355Test-1853316162 None] Lock "cinder-757abd70-3df8-4f0c-8951-022aa879100d-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "cinder-f381410f-e268-4e07-bde5-01c974b019f0-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-f381410f-e268-4e07-bde5-01c974b019f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "cinder-quobyte-f381410f-e268-4e07-bde5-01c974b019f0" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-quobyte-f381410f-e268-4e07-bde5-01c974b019f0" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f22083-d247-47eb-9943-34bd0a9b8db9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:41 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.866s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Deleted volume successfully. Jul 07 15:15:41 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 Jul 07 15:15:41 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1abb41e6-51f7-41ee-975d-f55d19f13f28 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-5abef784-f8b7-418c-a376-303e036f0c87-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-cec22463-aeeb-4079-a6d5-b6bc7be9c4f5-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-cec22463-aeeb-4079-a6d5-b6bc7be9c4f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Acquiring lock "cinder-quobyte-cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Deleting offline snapshot cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] snapshot_file for this snap is: volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6999f59-6ace-4b7e-b3a8-8b37be4d8758]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:41 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 Jul 07 15:15:41 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:41 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" returned: 0 in 1.080s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c5258fd-0732-4230-8677-c207d5d88560(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcfff0d-f9fd-4e30-a80f-bcfd680a5d5c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:41 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 Jul 07 15:15:41 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:42 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0" returned: 0 in 1.051s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:42 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0 Jul 07 15:15:42 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:42 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" returned: 0 in 0.937s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b0eb3-66fe-4be3-a90f-e7d77ae189ab]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:42 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:42 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:42 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560" returned: 0 in 0.945s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:42 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 Jul 07 15:15:42 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:42 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f381410f-e268-4e07-bde5-01c974b019f0" returned: 0 in 0.830s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-quobyte-f381410f-e268-4e07-bde5-01c974b019f0" released by "delete_volume" :: held 1.950s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Created reservations ['d441bf72-bcff-4df6-aa96-970aa17ff27f', '4f9493d9-2ddb-4d33-a1fd-988f07222b78', '5fd4b77e-e238-44a7-adb2-cf9b9d46a172', '270dc1a0-e707-4497-9795-3cc99bbe6ac2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:43 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:43 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:43 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 1.000s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:43 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 Jul 07 15:15:43 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:44 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.214s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:44 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Deleted volume successfully. Jul 07 15:15:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-51ad0a76-6189-4308-bbef-798dacf59e02 tempest-AttachVolumeTestJSON-1298375289 None] Lock "cinder-f381410f-e268-4e07-bde5-01c974b019f0-delete_volume" released by "delete_volume" :: held 3.598s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:45 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" returned: 0 in 2.124s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:45 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5 Jul 07 15:15:45 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:47 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" returned: 0 in 2.141s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-cec22463-aeeb-4079-a6d5-b6bc7be9c4f5" released by "_delete_snapshot" :: held 6.390s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" released by "delete_snapshot" :: held 6.444s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:47 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Created reservations ['8f995bff-3ac0-47ab-92ca-0060a59c4e50', 'b5dca181-29d9-42e8-a996-c4d7c9e9bc78', 'e65f9c7e-5200-400d-b0ba-39dfcd5f5761', '95a66f63-f9f1-4d82-b2cd-41b6f71c48f9'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Delete snapshot completed successfully. Jul 07 15:15:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-423a3ff4-56be-4efc-ace5-84cf84dc0de4 tempest-SnapshotsActionsTest-388912206 None] Lock "cinder-cec22463-aeeb-4079-a6d5-b6bc7be9c4f5-delete_snapshot" released by "delete_snapshot" :: held 6.862s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:49 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670" returned: 0 in 6.552s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c917988d-0e5d-4ea4-b87f-e668bbe536d4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:49 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 Jul 07 15:15:49 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "cinder-a7d7b545-87a7-4330-858e-48b4d71afbe0-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-a7d7b545-87a7-4330-858e-48b4d71afbe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "cinder-quobyte-a7d7b545-87a7-4330-858e-48b4d71afbe0" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-quobyte-a7d7b545-87a7-4330-858e-48b4d71afbe0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Deleting offline snapshot a7d7b545-87a7-4330-858e-48b4d71afbe0 of volume 7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] snapshot_file for this snap is: volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5919631-9634-4956-8dc9-71006c7284c5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:49 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:49 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:50 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560" returned: 0 in 1.076s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:50 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:15:50 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Converted 1024.00 MB image at 156.28 MB/s Jul 07 15:15:50 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 is being set with open permissions: ugo+rw Jul 07 15:15:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:50 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 Jul 07 15:15:50 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:50 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.960s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f0efff3-0aca-4e63-abac-7adba40c2174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[29026512-9f82-4e08-92c8-eeb1c70efc0b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:50 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 Jul 07 15:15:50 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:51 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670" returned: 0 in 0.952s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-4be882c6-3032-4a0d-95e5-f1f7adde3670" released by "_copy_volume_from_snapshot" :: held 10.733s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74-4be882c6-3032-4a0d-95e5-f1f7adde3670" released by "_create_volume_from_snapshot" :: held 10.784s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.845s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379027f9-cbd0-4484-828b-159e5fd8f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be882c6-3032-4a0d-95e5-f1f7adde3670', 'volume_size': 1, 'snapshot_id': '7a4e3942-9dbb-43a7-8bbd-65fc80d45e74'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1615081-0bb3-4e1e-a311-bb4fd0a31892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:51 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Volume volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 (4be882c6-3032-4a0d-95e5-f1f7adde3670): created successfully Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1615081-0bb3-4e1e-a311-bb4fd0a31892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Flow 'volume_create_manager' (b860b822-3b88-4073-b13e-648f28c3d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8d1ef744-6b38-4c64-98d8-a8af62f37ec0 tempest-VolumesSnapshotTestJSON-540025096 None] Created volume successfully. Jul 07 15:15:51 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174" returned: 0 in 1.082s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:51 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:51 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-4be882c6-3032-4a0d-95e5-f1f7adde3670-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-4be882c6-3032-4a0d-95e5-f1f7adde3670-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-4be882c6-3032-4a0d-95e5-f1f7adde3670" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-4be882c6-3032-4a0d-95e5-f1f7adde3670" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c175fe-c973-479b-989d-beb2ddabd62f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:52 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 Jul 07 15:15:52 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:52 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.951s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:52 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0 Jul 07 15:15:52 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:53 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670" returned: 0 in 1.100s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:53 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670 Jul 07 15:15:53 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:53 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174.a7d7b545-87a7-4330-858e-48b4d71afbe0" returned: 0 in 0.861s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-quobyte-a7d7b545-87a7-4330-858e-48b4d71afbe0" released by "_delete_snapshot" :: held 4.067s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" released by "delete_snapshot" :: held 4.104s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Created reservations ['339ae213-aeca-49dc-819c-04922c79593c', 'bde05eb7-583d-4859-95f5-3915073f26a9', 'fa991b7c-5941-477e-a5d9-bd080af65da5', '5d253a01-bf29-423f-8857-3c5e0b1094f6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:53 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Delete snapshot completed successfully. Jul 07 15:15:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-96e9d0eb-455a-4d74-ae2a-ca9df61b273c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-a7d7b545-87a7-4330-858e-48b4d71afbe0-delete_snapshot" released by "delete_snapshot" :: held 4.350s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:54 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4be882c6-3032-4a0d-95e5-f1f7adde3670" returned: 0 in 0.788s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-4be882c6-3032-4a0d-95e5-f1f7adde3670" released by "delete_volume" :: held 1.940s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['efee4bdc-eff4-407c-84ff-e33c3e302de6', '30c0d76b-30f4-4b19-820e-f18ec4f41aae', '247e6d8c-4638-48f1-85f1-9cb616f1d8bd', 'fa8b6d45-1c58-4fc3-85f9-b851ae29064d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:54 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:54 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-3c5258fd-0732-4230-8677-c207d5d88560" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-3c5258fd-0732-4230-8677-c207d5d88560" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Deleting offline snapshot 7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 of volume 3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] snapshot_file for this snap is: volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eb5912-a0ba-47c7-8b40-b6b08e845047]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:54 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 Jul 07 15:15:54 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "cinder-7f0efff3-0aca-4e63-abac-7adba40c2174-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-7f0efff3-0aca-4e63-abac-7adba40c2174-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" acquired by "delete_volume" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9553796-b92f-42d2-9e06-2c92bce8c044]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:55 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.995s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:55 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Deleted volume successfully. Jul 07 15:15:55 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 Jul 07 15:15:55 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-00ac7725-38a7-4271-8bcb-dd1e22f172cf tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-4be882c6-3032-4a0d-95e5-f1f7adde3670-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Flow 'volume_create_manager' (caae5512-0f1c-4418-9fd4-6da981e01d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa7474a-64cf-4e11-89b6-aacdb53796ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa7474a-64cf-4e11-89b6-aacdb53796ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-209768235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414f1715-5b80-4ba0-ab58-abaaa7203f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ab4730d024460be1824f738a227ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:56Z,use_quota=True,user_id='4a7e7d10c9844c54b7c6bafbcebdc634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b1fbdc-b597-4931-8e04-1058773fbb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b1fbdc-b597-4931-8e04-1058773fbb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da9ac84-68bd-4a95-8af2-3bc78bb2b930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da9ac84-68bd-4a95-8af2-3bc78bb2b930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414f1715-5b80-4ba0-ab58-abaaa7203f7c', 'volume_name': 'volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d3fc54-64fb-473a-9eed-ca374fc0ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d3fc54-64fb-473a-9eed-ca374fc0ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ff4c38-ac38-4e7b-b9a1-48cbd202037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:56 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Volume 414f1715-5b80-4ba0-ab58-abaaa7203f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c', 'volume_size': 1} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-209768235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414f1715-5b80-4ba0-ab58-abaaa7203f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5ab4730d024460be1824f738a227ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:15:56Z,use_quota=True,user_id='4a7e7d10c9844c54b7c6bafbcebdc634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:15:56 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Creating volume 414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:15:56 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" returned: 0 in 1.220s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c5258fd-0732-4230-8677-c207d5d88560(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:15:56 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c 1073741824 Jul 07 15:15:56 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d61634-6cc7-4ac1-b78c-6136f1710b92]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:56 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 Jul 07 15:15:56 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:56 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174" returned: 0 in 1.153s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:56 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174 Jul 07 15:15:56 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:57 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c 1073741824" returned: 0 in 1.102s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:57 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560" returned: 0 in 1.112s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:57 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c Jul 07 15:15:57 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:57 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 Jul 07 15:15:57 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:57 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7f0efff3-0aca-4e63-abac-7adba40c2174" returned: 0 in 0.801s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-quobyte-7f0efff3-0aca-4e63-abac-7adba40c2174" released by "delete_volume" :: held 2.054s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Created reservations ['5804cd48-6a22-4d2c-bb26-f2cfcb1122d9', 'f807cd1d-84a4-4261-ad83-bb54e1743cbe', 'fc3ffb15-a734-4d79-87fb-b1168165cda0', 'b560ccc1-7a29-4819-9dfd-5e6dda401399'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:57 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:15:57 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:58 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c" returned: 0 in 0.835s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ff4c38-ac38-4e7b-b9a1-48cbd202037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2618e5c3-aa63-48a6-a612-ac1c2000b85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:15:58 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Volume volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c (414f1715-5b80-4ba0-ab58-abaaa7203f7c): created successfully Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2618e5c3-aa63-48a6-a612-ac1c2000b85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Flow 'volume_create_manager' (caae5512-0f1c-4418-9fd4-6da981e01d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:15:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-bda960ba-a37d-440e-a063-1a369ed0f6ed req-c3bd89d1-85ff-4558-9637-66d8ec951aea tempest-VolumesSnapshotsTestJSON-1130655214 None] Created volume successfully. Jul 07 15:15:58 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" returned: 0 in 0.950s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:58 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74 Jul 07 15:15:58 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:15:58 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.796s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:15:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Deleted volume successfully. Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6da99f1d-6fa4-46ad-8d8d-44c6bb74196c tempest-SnapshotsActionsTest-1408577742 None] Lock "cinder-7f0efff3-0aca-4e63-abac-7adba40c2174-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:58 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 07 15:15:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560.7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" returned: 0 in 0.779s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74" released by "_delete_snapshot" :: held 4.225s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-3c5258fd-0732-4230-8677-c207d5d88560" released by "delete_snapshot" :: held 4.259s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['80f9f14f-7554-4619-824a-8769d7c8eb7e', '6a42d639-1b50-4f61-86a2-1751d965906d', '2fbb4914-b9c9-48e1-9ca0-ff2a65883188', 'baa5133e-d311-4b0b-9642-00cc2d586847'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:15:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Delete snapshot completed successfully. Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2e06fdd8-61d7-495f-9855-5008aedafb4e tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-7a4e3942-9dbb-43a7-8bbd-65fc80d45e74-delete_snapshot" released by "delete_snapshot" :: held 4.451s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Creating offline snapshot e0282703-d194-457f-8e87-24e12137afef of volume 414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf9b00-5849-4643-8063-c0897bbc58f5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:15:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:15:59 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c Jul 07 15:15:59 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:00 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:00 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-3c5258fd-0732-4230-8677-c207d5d88560-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-3c5258fd-0732-4230-8677-c207d5d88560-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-3c5258fd-0732-4230-8677-c207d5d88560" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-3c5258fd-0732-4230-8677-c207d5d88560" acquired by "delete_volume" :: waited 0.041s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c0cfe-2b8a-4f45-8181-197324d91843]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:00 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 Jul 07 15:16:00 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:00 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c" returned: 0 in 1.215s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:00 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef 1G Jul 07 15:16:00 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:00 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.873s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:16:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:16:01 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560" returned: 0 in 1.174s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:01 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560 Jul 07 15:16:01 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:01 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef 1G" returned: 0 in 1.200s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:01 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef Jul 07 15:16:01 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:02 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3c5258fd-0732-4230-8677-c207d5d88560" returned: 0 in 1.018s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-3c5258fd-0732-4230-8677-c207d5d88560" released by "delete_volume" :: held 2.292s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['44302e54-2e13-466b-9864-83c809e4e554', '5371800d-954e-4ea3-a7f7-711744405b8a', '348471d5-2d19-4c40-97db-d6ecd874899e', '0e3f9b00-7d22-48a0-a53f-e56c74b80993'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:02 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:02 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:02 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef" returned: 0 in 1.052s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:02 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef is being set with open permissions: ugo+rw Jul 07 15:16:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:03 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef Jul 07 15:16:03 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:03 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef" returned: 0 in 0.711s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:03 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.860s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:03 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Deleted volume successfully. Jul 07 15:16:03 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.info Jul 07 15:16:03 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0d1cff73-b6a2-47d9-ba98-af56037034b9 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-3c5258fd-0732-4230-8677-c207d5d88560-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-f5d2e273-1a8f-4ba9-ba88-411e51b3342c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-f5d2e273-1a8f-4ba9-ba88-411e51b3342c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "cinder-quobyte-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" acquired by "delete_volume" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03dff5e-123d-44ec-8d9e-208d3c9e44c0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:04 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c Jul 07 15:16:04 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:04 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.info" returned: 0 in 0.840s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:04 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.info is being set with open permissions: ugo+rw Jul 07 15:16:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:04 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.info Jul 07 15:16:04 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:05 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" returned: 0 in 0.998s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:05 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c Jul 07 15:16:05 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:05 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.info" returned: 0 in 0.784s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.945s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-34a4761d-f69b-4394-a923-cbdd0aca8250 req-0e674f9f-ecfa-4edd-b372-b7a3e3584538 tempest-VolumesSnapshotsTestJSON-1130655214 None] Create snapshot completed successfully Jul 07 15:16:05 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" returned: 0 in 0.740s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-quobyte-f5d2e273-1a8f-4ba9-ba88-411e51b3342c" released by "delete_volume" :: held 1.840s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:05 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Created reservations ['a828ef6a-2272-454a-a87b-406f21d6c262', 'c9a40db3-267e-4d85-87f0-07f4090600e6', '787316da-b2a5-4538-aada-1afc377ed740', '8bfce9ad-e5e3-4eca-9c37-a93a693c53fe'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:06 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:06 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:06 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.697s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Deleted volume successfully. Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ae832c2-62d2-49fd-9b86-9e70deb2fe73 tempest-VolumesSnapshotTestJSON-540025096 None] Lock "cinder-f5d2e273-1a8f-4ba9-ba88-411e51b3342c-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "cinder-e0282703-d194-457f-8e87-24e12137afef-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-e0282703-d194-457f-8e87-24e12137afef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "cinder-quobyte-414f1715-5b80-4ba0-ab58-abaaa7203f7c" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-quobyte-414f1715-5b80-4ba0-ab58-abaaa7203f7c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "cinder-quobyte-e0282703-d194-457f-8e87-24e12137afef" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-quobyte-e0282703-d194-457f-8e87-24e12137afef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Deleting offline snapshot e0282703-d194-457f-8e87-24e12137afef of volume 414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:16:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] snapshot_file for this snap is: volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:16:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f8608a-c87a-455b-aae5-24daae0f8b61]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:07 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef Jul 07 15:16:07 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:07 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef" returned: 0 in 0.914s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe3529e-2845-4017-ba48-9b2d1b9b844d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:08 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c Jul 07 15:16:08 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:09 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c" returned: 0 in 1.049s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:09 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef Jul 07 15:16:09 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:09 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef" returned: 0 in 0.978s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:10 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef Jul 07 15:16:10 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:10 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c.e0282703-d194-457f-8e87-24e12137afef" returned: 0 in 0.672s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-quobyte-e0282703-d194-457f-8e87-24e12137afef" released by "_delete_snapshot" :: held 3.773s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-quobyte-414f1715-5b80-4ba0-ab58-abaaa7203f7c" released by "delete_snapshot" :: held 3.797s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:10 devstack cinder-volume[87257]: DEBUG cinder.quota [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Created reservations ['171b4f67-6aa9-43d9-a91e-3e813443967c', 'e66a3714-0057-4113-82f3-b424f6537263', '710e086a-6fa3-4c7c-b589-e8e776f2eb68', '76e3ebdd-9c95-40aa-8632-feb4b8a33299'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Delete snapshot completed successfully. Jul 07 15:16:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-0c3be986-64d3-4e55-adc6-257faa389acb req-7bf4badc-d8d0-43c2-a0dd-78722a6f9620 tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-e0282703-d194-457f-8e87-24e12137afef-delete_snapshot" released by "delete_snapshot" :: held 4.010s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "cinder-414f1715-5b80-4ba0-ab58-abaaa7203f7c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-414f1715-5b80-4ba0-ab58-abaaa7203f7c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "cinder-quobyte-414f1715-5b80-4ba0-ab58-abaaa7203f7c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-quobyte-414f1715-5b80-4ba0-ab58-abaaa7203f7c" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c810ad1-c818-4560-9750-66ed65d452d3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:11 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c Jul 07 15:16:11 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:12 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c" returned: 0 in 0.850s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:12 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c Jul 07 15:16:12 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:13 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-414f1715-5b80-4ba0-ab58-abaaa7203f7c" returned: 0 in 0.900s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-quobyte-414f1715-5b80-4ba0-ab58-abaaa7203f7c" released by "delete_volume" :: held 1.841s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG cinder.quota [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Created reservations ['5cb288ff-852d-4ead-8c9e-d846639fdb67', '40b6ad02-4cdc-4dad-835d-68af87ac96fe', '84971f0d-ee24-489f-8da0-97b340f660d4', 'e0504bb9-211d-43d4-8237-3ae94cd82435'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:13 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:13 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:14 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.209s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:14 devstack cinder-volume[87257]: DEBUG cinder.manager [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:14 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Deleted volume successfully. Jul 07 15:16:14 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-145d6903-0f4a-418d-8dbd-c979a8b84204 req-49e53d75-43c0-416c-85d2-0e143ad9b3ec tempest-VolumesSnapshotsTestJSON-1130655214 None] Lock "cinder-414f1715-5b80-4ba0-ab58-abaaa7203f7c-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Flow 'volume_create_manager' (874c52f7-5a07-451c-a605-17bf90357fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e527f93c-d325-447f-8ef5-30e253593363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e527f93c-d325-447f-8ef5-30e253593363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1788625438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56faa102-3605-45da-b11b-4f293fad5eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0fd78c22d94b959e2ff9f68f9f1a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:16Z,use_quota=True,user_id='64ce4c4a38674ed8ab6b6fbc010138ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f872dc-a468-43cf-9e61-969f2d2d4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f872dc-a468-43cf-9e61-969f2d2d4e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74158fd8-4a49-442b-b686-daf7ca86eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74158fd8-4a49-442b-b686-daf7ca86eb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56faa102-3605-45da-b11b-4f293fad5eed', 'volume_name': 'volume-56faa102-3605-45da-b11b-4f293fad5eed', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469b74aa-b2cc-4b31-8038-41729dc30513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469b74aa-b2cc-4b31-8038-41729dc30513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f2ba97-03ef-4cef-a820-941442a6b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Volume 56faa102-3605-45da-b11b-4f293fad5eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56faa102-3605-45da-b11b-4f293fad5eed', 'volume_size': 1} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1788625438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56faa102-3605-45da-b11b-4f293fad5eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0fd78c22d94b959e2ff9f68f9f1a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:16Z,use_quota=True,user_id='64ce4c4a38674ed8ab6b6fbc010138ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Creating volume 56faa102-3605-45da-b11b-4f293fad5eed {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:16 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:16 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed 1073741824 Jul 07 15:16:16 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Flow 'volume_create_manager' (51c3c221-99bb-424f-a2ef-8b37d79194db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c113fa4-46ab-4c32-b097-a1c0f9b64717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c113fa4-46ab-4c32-b097-a1c0f9b64717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1161932300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889a4988-c9df-4bab-8da3-d7b9f0604339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0fd78c22d94b959e2ff9f68f9f1a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:17Z,use_quota=True,user_id='64ce4c4a38674ed8ab6b6fbc010138ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b257de-4af9-4d74-8520-e32ab940e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b257de-4af9-4d74-8520-e32ab940e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cd4712-1d3d-4984-aa53-d08d57e7e49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cd4712-1d3d-4984-aa53-d08d57e7e49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889a4988-c9df-4bab-8da3-d7b9f0604339', 'volume_name': 'volume-889a4988-c9df-4bab-8da3-d7b9f0604339', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4b8356-1768-40c2-880e-15b0b0210611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4b8356-1768-40c2-880e-15b0b0210611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8202ca13-0432-4901-ad79-f7d5af1c477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:16 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Volume 889a4988-c9df-4bab-8da3-d7b9f0604339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889a4988-c9df-4bab-8da3-d7b9f0604339', 'volume_size': 1} Jul 07 15:16:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:17 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed 1073741824" returned: 0 in 1.171s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:17 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed Jul 07 15:16:17 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:18 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed" returned: 0 in 1.105s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.873s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1161932300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889a4988-c9df-4bab-8da3-d7b9f0604339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0fd78c22d94b959e2ff9f68f9f1a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:17Z,use_quota=True,user_id='64ce4c4a38674ed8ab6b6fbc010138ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Creating volume 889a4988-c9df-4bab-8da3-d7b9f0604339 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:18 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f2ba97-03ef-4cef-a820-941442a6b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56faa102-3605-45da-b11b-4f293fad5eed', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277e7297-e87c-4924-be1b-0a2faf9539b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:18 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 1073741824 Jul 07 15:16:18 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Flow 'volume_create_manager' (7af50653-94b5-4de2-b2db-63283e15663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7b0ec-c30a-4455-aa86-bf765e7b1517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:18 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Volume volume-56faa102-3605-45da-b11b-4f293fad5eed (56faa102-3605-45da-b11b-4f293fad5eed): created successfully Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277e7297-e87c-4924-be1b-0a2faf9539b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Flow 'volume_create_manager' (874c52f7-5a07-451c-a605-17bf90357fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7b0ec-c30a-4455-aa86-bf765e7b1517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-728386754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b76924-61c5-4b90-8f72-b8c1d525fc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92d8b1b34f24af086a9805e5867efc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:19Z,use_quota=True,user_id='2858102884a5463bab236e672a7b7b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0330ffc-fb4e-4c14-87bd-4abea3534a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0330ffc-fb4e-4c14-87bd-4abea3534a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee23b066-d8fa-4001-b7f8-0557b93cc758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee23b066-d8fa-4001-b7f8-0557b93cc758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b76924-61c5-4b90-8f72-b8c1d525fc0c', 'volume_name': 'volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0607e12-af49-461c-be47-8631661ff05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0607e12-af49-461c-be47-8631661ff05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ff8d3c-5307-4ad2-b332-bc5b296786f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:18 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c', 'volume_size': 1} Jul 07 15:16:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ea878151-e681-44fd-b8ac-cbf2a56cabdd tempest-TestServerVolumeAttachmentScenario-956382829 None] Created volume successfully. Jul 07 15:16:19 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 1073741824" returned: 0 in 1.104s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Flow 'volume_create_manager' (b15b6ec2-4a47-47b0-8329-94cfe4071a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89955850-4a15-4b1f-bdb2-c51c00906afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89955850-4a15-4b1f-bdb2-c51c00906afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1282280076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049a9f90-4362-497e-b146-18ebbc668c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211255ca8cfc4b56b39945cd24fe6df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:20Z,use_quota=True,user_id='0b4f40c5e0de46ec9f0d81e399cc1b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:19 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 Jul 07 15:16:19 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a71822-0662-4b28-9484-b9c8ceb9b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a71822-0662-4b28-9484-b9c8ceb9b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8dc12a6-d16a-4099-a57b-933426d7c23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8dc12a6-d16a-4099-a57b-933426d7c23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049a9f90-4362-497e-b146-18ebbc668c4c', 'volume_name': 'volume-049a9f90-4362-497e-b146-18ebbc668c4c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60986228-3f8b-4f81-88af-dc001d4547ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60986228-3f8b-4f81-88af-dc001d4547ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d911432-ad51-4908-a383-08e7963cb47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:19 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Volume 049a9f90-4362-497e-b146-18ebbc668c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049a9f90-4362-497e-b146-18ebbc668c4c', 'volume_size': 1} Jul 07 15:16:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:20 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339" returned: 0 in 0.803s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.759s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-728386754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b76924-61c5-4b90-8f72-b8c1d525fc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92d8b1b34f24af086a9805e5867efc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:19Z,use_quota=True,user_id='2858102884a5463bab236e672a7b7b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Creating volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:20 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:20 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c 1073741824 Jul 07 15:16:20 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8202ca13-0432-4901-ad79-f7d5af1c477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889a4988-c9df-4bab-8da3-d7b9f0604339', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a93716a-1ee7-4c8d-b405-b9becc6ed349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:20 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Volume volume-889a4988-c9df-4bab-8da3-d7b9f0604339 (889a4988-c9df-4bab-8da3-d7b9f0604339): created successfully Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a93716a-1ee7-4c8d-b405-b9becc6ed349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Flow 'volume_create_manager' (51c3c221-99bb-424f-a2ef-8b37d79194db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a1c07608-9453-47e3-a285-09c19a306074 tempest-TestServerVolumeAttachmentScenario-956382829 None] Created volume successfully. Jul 07 15:16:21 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c 1073741824" returned: 0 in 0.921s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:21 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c Jul 07 15:16:21 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:22 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" returned: 0 in 0.722s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.455s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1282280076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049a9f90-4362-497e-b146-18ebbc668c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211255ca8cfc4b56b39945cd24fe6df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:20Z,use_quota=True,user_id='0b4f40c5e0de46ec9f0d81e399cc1b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Creating volume 049a9f90-4362-497e-b146-18ebbc668c4c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:22 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:INSERT=39,cinder:UPDATE=162,cinder:SELECT=112,cinder:DELETE=8 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ff8d3c-5307-4ad2-b332-bc5b296786f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:22 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c 1073741824 Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee6aa99-e11a-4486-a3f6-43c6c3764325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:22 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=119,cinder:INSERT=38,cinder:UPDATE=136,cinder:DELETE=14 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:16:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Volume volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c (f4b76924-61c5-4b90-8f72-b8c1d525fc0c): created successfully Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee6aa99-e11a-4486-a3f6-43c6c3764325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Flow 'volume_create_manager' (7af50653-94b5-4de2-b2db-63283e15663d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:22 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3ad1b8f1-739d-48a0-af1c-21f6e260a121 tempest-VolumesSnapshotListTestJSON-1264429752 None] Created volume successfully. Jul 07 15:16:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:23 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c 1073741824" returned: 0 in 0.994s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:23 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c Jul 07 15:16:23 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:24 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c" returned: 0 in 0.655s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.851s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d911432-ad51-4908-a383-08e7963cb47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049a9f90-4362-497e-b146-18ebbc668c4c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33185dc2-b092-4507-b5ba-30035dffc1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Creating offline snapshot 5c9684a8-2cd2-47a7-8876-7a4b563b131c of volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:16:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Volume volume-049a9f90-4362-497e-b146-18ebbc668c4c (049a9f90-4362-497e-b146-18ebbc668c4c): created successfully Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33185dc2-b092-4507-b5ba-30035dffc1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Flow 'volume_create_manager' (b15b6ec2-4a47-47b0-8329-94cfe4071a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c9adf2-ec92-4dd3-b55a-b3a210f60755]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3538ffac-0a66-46bd-801a-6f94b735a130 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Created volume successfully. Jul 07 15:16:24 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c Jul 07 15:16:24 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:24 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" returned: 0 in 0.799s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:25 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c 1G Jul 07 15:16:25 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Acquiring lock "cinder-049a9f90-4362-497e-b146-18ebbc668c4c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "cinder-049a9f90-4362-497e-b146-18ebbc668c4c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Acquiring lock "cinder-quobyte-049a9f90-4362-497e-b146-18ebbc668c4c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "cinder-quobyte-049a9f90-4362-497e-b146-18ebbc668c4c" acquired by "delete_volume" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c893b96c-66ca-4a91-be18-349f84378dbb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:25 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c Jul 07 15:16:25 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-55ab10b5-ce20-465f-8b43-4faf0f2e3c4a tempest-GroupsTest-628932710 None] Group tempest-Group1-1244669181: creating Jul 07 15:16:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-55ab10b5-ce20-465f-8b43-4faf0f2e3c4a tempest-GroupsTest-628932710 None] Group tempest-Group1-1244669181: created successfully Jul 07 15:16:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-55ab10b5-ce20-465f-8b43-4faf0f2e3c4a tempest-GroupsTest-628932710 None] Create group completed successfully. Jul 07 15:16:26 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c 1G" returned: 0 in 1.203s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:26 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c Jul 07 15:16:26 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:26 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c" returned: 0 in 1.063s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:26 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c Jul 07 15:16:26 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:27 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f00c4e09-718f-4461-8b17-01ab647013cf tempest-GroupsTest-628932710 None] Group tempest-Group2-2129222652: creating Jul 07 15:16:27 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c" returned: 0 in 0.968s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:27 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c is being set with open permissions: ugo+rw Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:27 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f00c4e09-718f-4461-8b17-01ab647013cf tempest-GroupsTest-628932710 None] Group tempest-Group2-2129222652: created successfully Jul 07 15:16:27 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c Jul 07 15:16:27 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:27 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f00c4e09-718f-4461-8b17-01ab647013cf tempest-GroupsTest-628932710 None] Create group completed successfully. Jul 07 15:16:27 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-049a9f90-4362-497e-b146-18ebbc668c4c" returned: 0 in 0.860s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "cinder-quobyte-049a9f90-4362-497e-b146-18ebbc668c4c" released by "delete_volume" :: held 1.989s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Created reservations ['3961db79-a93c-4f28-b1ba-977ebe4e94df', 'c7041e48-fc4b-4c1a-a3f6-d7530e4ca017', '7c3396e8-b634-4a18-b092-7cb0a91471f1', 'a8337b64-4d56-43ea-a263-432e1ade992b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:27 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:27 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:27 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c" returned: 0 in 0.829s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:28 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.info Jul 07 15:16:28 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:28 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Deleted volume successfully. Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f4b48c0a-764d-4d22-9930-8148b78c5a0d tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "cinder-049a9f90-4362-497e-b146-18ebbc668c4c-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:28 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.info" returned: 0 in 0.732s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:28 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.info is being set with open permissions: ugo+rw Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:28 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.info Jul 07 15:16:28 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Flow 'volume_create_manager' (ad514bbe-0d0d-44fa-8b71-eee73d11ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc59cb8-9e02-4e99-b59a-711331bb15b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc59cb8-9e02-4e99-b59a-711331bb15b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36122879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69144cca-2176-4220-b5a6-e0ababe755a2,host='devstack@QuobyteHD#QuobyteHD',id=a71b9b60-2221-4717-8487-19d7e3902a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438837c16f554f0c95910552af2a0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:29Z,use_quota=True,user_id='97c6d9f27b9441b3ae7c6241a9c1b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c348b2b9-d8cd-4111-a185-c5f2057c25e1),volume_type_id=c348b2b9-d8cd-4111-a185-c5f2057c25e1)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1b0d79-59f0-46ae-a6bb-439ec4cd515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1b0d79-59f0-46ae-a6bb-439ec4cd515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d437da-fe5f-4e35-92c9-a6a9263ed765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d437da-fe5f-4e35-92c9-a6a9263ed765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a71b9b60-2221-4717-8487-19d7e3902a0c', 'volume_name': 'volume-a71b9b60-2221-4717-8487-19d7e3902a0c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d00ddbb-17e1-4309-b015-96aab7125aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d00ddbb-17e1-4309-b015-96aab7125aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373c3a8d-0e76-4944-848d-9d7f991c2f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Volume a71b9b60-2221-4717-8487-19d7e3902a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a71b9b60-2221-4717-8487-19d7e3902a0c', 'volume_size': 1} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Flow 'volume_create_manager' (0dd0b1e2-a39e-4905-a440-6aaa61f2f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaf201d-98cb-4fcf-b374-bb4564ca0d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaf201d-98cb-4fcf-b374-bb4564ca0d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-666820145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=686539f9-b7db-4da2-8be0-acb712b833c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211255ca8cfc4b56b39945cd24fe6df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:29Z,use_quota=True,user_id='0b4f40c5e0de46ec9f0d81e399cc1b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b4f805-f241-4d2e-962f-36d95d3c147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b4f805-f241-4d2e-962f-36d95d3c147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504a14e0-b981-401e-97d2-5f0b87d332e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504a14e0-b981-401e-97d2-5f0b87d332e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '686539f9-b7db-4da2-8be0-acb712b833c0', 'volume_name': 'volume-686539f9-b7db-4da2-8be0-acb712b833c0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f296ce7-7b0e-48bf-b1b8-101bb6d964e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f296ce7-7b0e-48bf-b1b8-101bb6d964e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9bbf3f-74b1-4bbc-97eb-0f066ff6d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Volume 686539f9-b7db-4da2-8be0-acb712b833c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-686539f9-b7db-4da2-8be0-acb712b833c0', 'volume_size': 1} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:29 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.info" returned: 0 in 0.743s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.400s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=69144cca-2176-4220-b5a6-e0ababe755a2,created_at=2026-07-07T13:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36122879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69144cca-2176-4220-b5a6-e0ababe755a2,host='devstack@QuobyteHD#QuobyteHD',id=a71b9b60-2221-4717-8487-19d7e3902a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438837c16f554f0c95910552af2a0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:29Z,use_quota=True,user_id='97c6d9f27b9441b3ae7c6241a9c1b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c348b2b9-d8cd-4111-a185-c5f2057c25e1),volume_type_id=c348b2b9-d8cd-4111-a185-c5f2057c25e1)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Creating volume a71b9b60-2221-4717-8487-19d7e3902a0c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:29 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:29 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c 1073741824 Jul 07 15:16:29 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2e459739-0dff-442b-a2f8-3a88db48522e tempest-VolumesSnapshotListTestJSON-1264429752 None] Create snapshot completed successfully Jul 07 15:16:30 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c 1073741824" returned: 0 in 0.827s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:30 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c Jul 07 15:16:30 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:31 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c" returned: 0 in 0.771s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.897s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-666820145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=686539f9-b7db-4da2-8be0-acb712b833c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211255ca8cfc4b56b39945cd24fe6df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:29Z,use_quota=True,user_id='0b4f40c5e0de46ec9f0d81e399cc1b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Creating volume 686539f9-b7db-4da2-8be0-acb712b833c0 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:31 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:31 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 1073741824 Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373c3a8d-0e76-4944-848d-9d7f991c2f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a71b9b60-2221-4717-8487-19d7e3902a0c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:31 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cea0d36-ee1c-410c-afd1-caa3b1ad7676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:31 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Volume volume-a71b9b60-2221-4717-8487-19d7e3902a0c (a71b9b60-2221-4717-8487-19d7e3902a0c): created successfully Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cea0d36-ee1c-410c-afd1-caa3b1ad7676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Flow 'volume_create_manager' (ad514bbe-0d0d-44fa-8b71-eee73d11ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2eee0f0e-d1a0-4f9f-9a0d-14e64446e488 tempest-GroupsTest-628932710 None] Created volume successfully. Jul 07 15:16:32 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 1073741824" returned: 0 in 1.052s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:32 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 Jul 07 15:16:32 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:32 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0" returned: 0 in 0.682s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.257s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Creating offline snapshot 892c608b-9b29-4081-ac79-edcfa3302e7a of volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9bbf3f-74b1-4bbc-97eb-0f066ff6d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-686539f9-b7db-4da2-8be0-acb712b833c0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb75aa8-2c79-420f-9447-d63939d6aefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6848f2eb-a95d-4ae9-8b2f-a7d843f99fc7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Acquiring lock "cinder-quobyte-a71b9b60-2221-4717-8487-19d7e3902a0c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:33 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Volume volume-686539f9-b7db-4da2-8be0-acb712b833c0 (686539f9-b7db-4da2-8be0-acb712b833c0): created successfully Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb75aa8-2c79-420f-9447-d63939d6aefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Flow 'volume_create_manager' (0dd0b1e2-a39e-4905-a440-6aaa61f2f29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3e428aa8-2746-4dc0-a90c-1c7d4de4a5b2 tempest-VolumeQuotasAdminTestJSON-2129130536 None] Created volume successfully. Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Lock "cinder-quobyte-a71b9b60-2221-4717-8487-19d7e3902a0c" acquired by "delete_volume" :: waited 0.042s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf0f7ac-a931-43e5-8d2f-386382993ed0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:33 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c Jul 07 15:16:33 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:33 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c Jul 07 15:16:33 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:34 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c" returned: 0 in 1.045s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e53ad3e6-7cde-4e1b-8aa2-cfaa25687139 tempest-VolumeQuotasAdminTestJSON-467937954 None] Transfer volume completed successfully. Jul 07 15:16:34 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a 1G Jul 07 15:16:34 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:34 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c" returned: 0 in 1.008s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:34 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c Jul 07 15:16:34 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:35 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a71b9b60-2221-4717-8487-19d7e3902a0c" returned: 0 in 0.859s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Lock "cinder-quobyte-a71b9b60-2221-4717-8487-19d7e3902a0c" released by "delete_volume" :: held 1.934s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Created reservations ['79b0e738-e651-4b31-af7a-08eb1308873a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:35 devstack cinder-volume[87257]: WARNING cinder.quota [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2074342368 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2074342368, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:16:35 devstack cinder-volume[87257]: WARNING cinder.quota [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2074342368 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2074342368, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Created reservations ['82185e39-c1a5-467e-b341-d900fa0814ec', 'd771c1f7-bc8d-4318-bfe4-679b7ae4b25b', '5557a44c-ac99-4e6e-a1cd-d67e7702e51b', '54ccb4cf-6f9b-4369-99bd-4c275d623185'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:35 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:35 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Acquiring lock "cinder-686539f9-b7db-4da2-8be0-acb712b833c0-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Lock "cinder-686539f9-b7db-4da2-8be0-acb712b833c0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:35 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a 1G" returned: 0 in 1.387s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:35 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a Jul 07 15:16:35 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Acquiring lock "cinder-quobyte-686539f9-b7db-4da2-8be0-acb712b833c0" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Lock "cinder-quobyte-686539f9-b7db-4da2-8be0-acb712b833c0" acquired by "delete_volume" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb810a4-ec87-4e8b-bdda-48fb7906e139]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:35 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 Jul 07 15:16:35 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Created reservations ['1f0ff372-2415-4429-bc33-c9fc6c57561b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:36 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:36 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:36 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a" returned: 0 in 1.295s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:36 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a is being set with open permissions: ugo+rw Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:36 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.489s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:36 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a Jul 07 15:16:36 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:36 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:36 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7c1c87ce-0251-403a-be8d-fb3cf86efffb tempest-GroupsTest-628932710 None] Delete group completed successfully. Jul 07 15:16:37 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0" returned: 0 in 1.590s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:37 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0 Jul 07 15:16:37 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:37 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.522s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-37bdf508-4eb1-464e-978c-015227e1413c tempest-GroupsTest-628932710 None] Delete group completed successfully. Jul 07 15:16:37 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a" returned: 0 in 1.118s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.103s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-554aaaa8-a227-4271-b26c-f0e306bd9a6e tempest-VolumesSnapshotListTestJSON-1264429752 None] Create snapshot completed successfully Jul 07 15:16:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-04d63fe7-b5ee-479f-9f98-b33cd709a182 tempest-GroupsTest-628932710 None] Group tempest-GroupsTest-Group-1018235215: creating Jul 07 15:16:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-04d63fe7-b5ee-479f-9f98-b33cd709a182 tempest-GroupsTest-628932710 None] Group tempest-GroupsTest-Group-1018235215: created successfully Jul 07 15:16:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-04d63fe7-b5ee-479f-9f98-b33cd709a182 tempest-GroupsTest-628932710 None] Create group completed successfully. Jul 07 15:16:38 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-686539f9-b7db-4da2-8be0-acb712b833c0" returned: 0 in 1.312s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Lock "cinder-quobyte-686539f9-b7db-4da2-8be0-acb712b833c0" released by "delete_volume" :: held 2.976s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Created reservations ['d4305576-7fdc-4207-8b07-9f923e60b326', '31c0f66b-0429-4a50-bbe6-1f9052971b37', 'e1a12de3-d14e-40af-bba2-361842f7a7e5', 'bedd258c-b4ca-4bc6-ad5e-51eecd7df46b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:38 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:38 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:39 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.842s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:39 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Deleted volume successfully. Jul 07 15:16:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2279bb95-a365-426d-a6a9-63b48bcf689a tempest-VolumeQuotasAdminTestJSON-245170796 None] Lock "cinder-686539f9-b7db-4da2-8be0-acb712b833c0-delete_volume" released by "delete_volume" :: held 4.145s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Creating offline snapshot 7988b016-2d81-4fa6-a6e8-f36fb128a3f4 of volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62209f-1e15-4a58-b3aa-4338dccb1e11]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:40 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a Jul 07 15:16:40 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Flow 'volume_create_manager' (6bbf8ddc-3dfb-41ba-bde3-7b5e6b7f0c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a4b849-fef3-4f0d-8b74-a1a5a867b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a4b849-fef3-4f0d-8b74-a1a5a867b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1159659238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3915725b-a196-4f4d-8466-05fac1e9f070,host='devstack@QuobyteHD#QuobyteHD',id=b7441ba3-96ae-4cae-8185-937bddf90ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438837c16f554f0c95910552af2a0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:41Z,use_quota=True,user_id='97c6d9f27b9441b3ae7c6241a9c1b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae8f5c50-e643-4b47-8f18-bbf0661e2e61),volume_type_id=ae8f5c50-e643-4b47-8f18-bbf0661e2e61)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095b02fd-db4d-41a6-99df-c18e1b5aee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095b02fd-db4d-41a6-99df-c18e1b5aee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379f6613-9e7b-4429-a184-e23ad94b5a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379f6613-9e7b-4429-a184-e23ad94b5a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7441ba3-96ae-4cae-8185-937bddf90ab0', 'volume_name': 'volume-b7441ba3-96ae-4cae-8185-937bddf90ab0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f73f5a-4566-4349-8efb-ba15ea49b9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f73f5a-4566-4349-8efb-ba15ea49b9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5dfbfb-4dfb-4acf-a458-abcb1a74e8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:40 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Volume b7441ba3-96ae-4cae-8185-937bddf90ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7441ba3-96ae-4cae-8185-937bddf90ab0', 'volume_size': 1} Jul 07 15:16:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:41 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a" returned: 0 in 1.098s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:41 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 1G Jul 07 15:16:41 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:42 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 1G" returned: 0 in 1.038s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:42 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 Jul 07 15:16:42 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:42 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4" returned: 0 in 0.754s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:42 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 is being set with open permissions: ugo+rw Jul 07 15:16:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:42 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 Jul 07 15:16:42 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:43 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4" returned: 0 in 0.782s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.857s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3915725b-a196-4f4d-8466-05fac1e9f070,created_at=2026-07-07T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1159659238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3915725b-a196-4f4d-8466-05fac1e9f070,host='devstack@QuobyteHD#QuobyteHD',id=b7441ba3-96ae-4cae-8185-937bddf90ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438837c16f554f0c95910552af2a0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:41Z,use_quota=True,user_id='97c6d9f27b9441b3ae7c6241a9c1b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae8f5c50-e643-4b47-8f18-bbf0661e2e61),volume_type_id=ae8f5c50-e643-4b47-8f18-bbf0661e2e61)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Creating volume b7441ba3-96ae-4cae-8185-937bddf90ab0 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:43 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 1073741824 Jul 07 15:16:43 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-361ed62b-28bf-4822-b0f0-72c54fae42a6 tempest-VolumesSnapshotListTestJSON-1264429752 None] Create snapshot completed successfully Jul 07 15:16:45 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 1073741824" returned: 0 in 1.305s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:45 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 Jul 07 15:16:45 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-7988b016-2d81-4fa6-a6e8-f36fb128a3f4-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-7988b016-2d81-4fa6-a6e8-f36fb128a3f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-quobyte-7988b016-2d81-4fa6-a6e8-f36fb128a3f4" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-7988b016-2d81-4fa6-a6e8-f36fb128a3f4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Deleting offline snapshot 7988b016-2d81-4fa6-a6e8-f36fb128a3f4 of volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] snapshot_file for this snap is: volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[147fcf27-2ac5-4d0e-b3bb-93bb80423c97]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:45 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 Jul 07 15:16:45 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:45 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0" returned: 0 in 0.794s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5dfbfb-4dfb-4acf-a458-abcb1a74e8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7441ba3-96ae-4cae-8185-937bddf90ab0', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165dc67d-e7f6-46be-8ca8-56bb2f519247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:45 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Volume volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 (b7441ba3-96ae-4cae-8185-937bddf90ab0): created successfully Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165dc67d-e7f6-46be-8ca8-56bb2f519247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Flow 'volume_create_manager' (6bbf8ddc-3dfb-41ba-bde3-7b5e6b7f0c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d7520a2b-a360-4ba5-b4eb-b72442664ad8 tempest-GroupsTest-628932710 None] Created volume successfully. Jul 07 15:16:46 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4" returned: 0 in 1.028s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d40ad-fa98-4a43-a006-c3d205681a1b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:46 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a Jul 07 15:16:46 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:47 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a" returned: 0 in 0.821s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:47 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 Jul 07 15:16:47 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Flow 'volume_create_manager' (74c7d7c1-b329-4ae9-9684-8c88f2dc1a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bdf6f0-507e-411e-84aa-e239fe9c8f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bdf6f0-507e-411e-84aa-e239fe9c8f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1162670066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3915725b-a196-4f4d-8466-05fac1e9f070,host='devstack@QuobyteHD#QuobyteHD',id=1c75765e-8e16-4c6b-ba94-8887d69623df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438837c16f554f0c95910552af2a0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:47Z,use_quota=True,user_id='97c6d9f27b9441b3ae7c6241a9c1b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae8f5c50-e643-4b47-8f18-bbf0661e2e61),volume_type_id=ae8f5c50-e643-4b47-8f18-bbf0661e2e61)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3a99ae-2322-4cb9-bb5a-3351214aee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3a99ae-2322-4cb9-bb5a-3351214aee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c22e141-daa6-479e-bbfe-7ef4f62cbc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c22e141-daa6-479e-bbfe-7ef4f62cbc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c75765e-8e16-4c6b-ba94-8887d69623df', 'volume_name': 'volume-1c75765e-8e16-4c6b-ba94-8887d69623df', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db6ad7f-e3df-4c40-b767-5c2d2c8e82a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db6ad7f-e3df-4c40-b767-5c2d2c8e82a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037fbe0-57ff-44e3-b5de-115483d36095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Volume 1c75765e-8e16-4c6b-ba94-8887d69623df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c75765e-8e16-4c6b-ba94-8887d69623df', 'volume_size': 1} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3915725b-a196-4f4d-8466-05fac1e9f070,created_at=2026-07-07T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1162670066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3915725b-a196-4f4d-8466-05fac1e9f070,host='devstack@QuobyteHD#QuobyteHD',id=1c75765e-8e16-4c6b-ba94-8887d69623df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438837c16f554f0c95910552af2a0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:47Z,use_quota=True,user_id='97c6d9f27b9441b3ae7c6241a9c1b769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae8f5c50-e643-4b47-8f18-bbf0661e2e61),volume_type_id=ae8f5c50-e643-4b47-8f18-bbf0661e2e61)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Creating volume 1c75765e-8e16-4c6b-ba94-8887d69623df {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:47 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:47 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df 1073741824 Jul 07 15:16:47 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Flow 'volume_create_manager' (726fe805-cd0d-44ca-8644-dd78e90cef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8a49a9-e02e-45a7-95f3-a32d85257fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8a49a9-e02e-45a7-95f3-a32d85257fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1935977543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32273243-c6c0-422a-b033-3b7f3e9fb60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0368cf50ca427eb49987e2a0851771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:48Z,use_quota=True,user_id='cc7baf1928a14c708b3cbea4486a5273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9d986f-b7ea-4182-b48b-20f189f7efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9d986f-b7ea-4182-b48b-20f189f7efa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61366826-7965-4714-a799-880640f75e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61366826-7965-4714-a799-880640f75e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32273243-c6c0-422a-b033-3b7f3e9fb60e', 'volume_name': 'volume-32273243-c6c0-422a-b033-3b7f3e9fb60e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32874f43-30d2-40f9-94d2-ebad5fb98a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32874f43-30d2-40f9-94d2-ebad5fb98a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d972ab-c67f-4883-b8c4-b834276f8ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Volume 32273243-c6c0-422a-b033-3b7f3e9fb60e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32273243-c6c0-422a-b033-3b7f3e9fb60e', 'volume_size': 1} Jul 07 15:16:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:48 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4" returned: 0 in 0.863s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:48 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4 Jul 07 15:16:48 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:48 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df 1073741824" returned: 0 in 0.830s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:48 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df Jul 07 15:16:48 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:48 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.7988b016-2d81-4fa6-a6e8-f36fb128a3f4" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-7988b016-2d81-4fa6-a6e8-f36fb128a3f4" released by "_delete_snapshot" :: held 3.473s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" released by "delete_snapshot" :: held 3.512s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:48 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Created reservations ['f822cdaa-b6d0-4bc3-9aa8-8b8cc1567b13', 'bc51ec99-75dd-454d-a5c9-58833c08f65b', 'a467b76a-1317-4c39-9bcb-960c24946607', 'b3ff7be1-49a8-48a8-b315-61d15bc8b8b9'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Delete snapshot completed successfully. Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bfd81b72-3c26-4dd9-aa94-716314a20f70 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-7988b016-2d81-4fa6-a6e8-f36fb128a3f4-delete_snapshot" released by "delete_snapshot" :: held 3.665s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:49 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df" returned: 0 in 0.709s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1935977543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32273243-c6c0-422a-b033-3b7f3e9fb60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0368cf50ca427eb49987e2a0851771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:16:48Z,use_quota=True,user_id='cc7baf1928a14c708b3cbea4486a5273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Creating volume 32273243-c6c0-422a-b033-3b7f3e9fb60e {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:16:49 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037fbe0-57ff-44e3-b5de-115483d36095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c75765e-8e16-4c6b-ba94-8887d69623df', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:49 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e 1073741824 Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39be970-e4a2-4503-b85f-c38bf912e373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:49 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:49 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Volume volume-1c75765e-8e16-4c6b-ba94-8887d69623df (1c75765e-8e16-4c6b-ba94-8887d69623df): created successfully Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39be970-e4a2-4503-b85f-c38bf912e373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Flow 'volume_create_manager' (74c7d7c1-b329-4ae9-9684-8c88f2dc1a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7ac3bf22-5db1-44ce-85ee-5c8de11b6d28 tempest-GroupsTest-628932710 None] Created volume successfully. Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-892c608b-9b29-4081-ac79-edcfa3302e7a-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-892c608b-9b29-4081-ac79-edcfa3302e7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-quobyte-892c608b-9b29-4081-ac79-edcfa3302e7a" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-892c608b-9b29-4081-ac79-edcfa3302e7a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Deleting offline snapshot 892c608b-9b29-4081-ac79-edcfa3302e7a of volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] snapshot_file for this snap is: volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c78b33-1837-4371-b8b1-3c6361b606e6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:49 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a Jul 07 15:16:49 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-adc0d961-731a-49ba-b6b1-16523bee5c3b tempest-GroupsTest-628932710 None] Update group completed successfully. Jul 07 15:16:50 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e 1073741824" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:50 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e Jul 07 15:16:50 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:50 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb9b6a-36b7-4fa2-a170-6a4d30fb3278]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:50 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c Jul 07 15:16:50 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:50 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e" returned: 0 in 0.654s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d972ab-c67f-4883-b8c4-b834276f8ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32273243-c6c0-422a-b033-3b7f3e9fb60e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc3a5bf-cd7f-41c4-b56b-9ee3b6485909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:16:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Volume volume-32273243-c6c0-422a-b033-3b7f3e9fb60e (32273243-c6c0-422a-b033-3b7f3e9fb60e): created successfully Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc3a5bf-cd7f-41c4-b56b-9ee3b6485909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:16:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Flow 'volume_create_manager' (726fe805-cd0d-44ca-8644-dd78e90cef8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:16:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3153a8f2-d00a-4ddc-bda1-2d6711deb333 tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Created volume successfully. Jul 07 15:16:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c9fa2bda-3f09-4162-b701-c0d2cab135da tempest-GroupsTest-628932710 None] Update group completed successfully. Jul 07 15:16:51 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:51 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a Jul 07 15:16:51 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Acquiring lock "cinder-32273243-c6c0-422a-b033-3b7f3e9fb60e-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "cinder-32273243-c6c0-422a-b033-3b7f3e9fb60e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Acquiring lock "cinder-quobyte-32273243-c6c0-422a-b033-3b7f3e9fb60e" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "cinder-quobyte-32273243-c6c0-422a-b033-3b7f3e9fb60e" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5cd7c0-ed48-455e-957e-4003e61fe176]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:52 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e Jul 07 15:16:52 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:52 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a" returned: 0 in 0.807s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:52 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a Jul 07 15:16:52 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:52 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e" returned: 0 in 0.845s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:52 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e Jul 07 15:16:52 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:53 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.892c608b-9b29-4081-ac79-edcfa3302e7a" returned: 0 in 0.862s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-892c608b-9b29-4081-ac79-edcfa3302e7a" released by "_delete_snapshot" :: held 3.374s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" released by "delete_snapshot" :: held 3.410s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Acquiring lock "cinder-quobyte-1c75765e-8e16-4c6b-ba94-8887d69623df" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Lock "cinder-quobyte-1c75765e-8e16-4c6b-ba94-8887d69623df" acquired by "delete_volume" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c26ee1a-940f-4b66-9275-6dd838216065]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Created reservations ['d1954618-c879-4e2e-bb83-0bd869181297', '2ad28608-924b-4d53-8103-4a623b792c21', 'dae440ba-8e40-4fc7-9068-f195db4fe249', '4e9d4507-166b-44df-b8e0-8658c15be053'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:53 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Delete snapshot completed successfully. Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4cbab59f-9d9f-4991-8b79-bfce9d142175 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-892c608b-9b29-4081-ac79-edcfa3302e7a-delete_snapshot" released by "delete_snapshot" :: held 3.683s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:53 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df Jul 07 15:16:53 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:53 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-32273243-c6c0-422a-b033-3b7f3e9fb60e" returned: 0 in 0.818s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "cinder-quobyte-32273243-c6c0-422a-b033-3b7f3e9fb60e" released by "delete_volume" :: held 1.705s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Created reservations ['ca9a5352-8f6d-4a15-9c10-2d11d8eb1ae4', 'e9bd5eb0-c4e3-49c7-91a0-a7b2091f2a6f', '3fd8d9f1-1708-4069-9a61-5dbcf591a271', 'd3e706c9-815d-4482-b181-690b6ee4b9d1'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:53 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:53 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-5c9684a8-2cd2-47a7-8876-7a4b563b131c-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-5c9684a8-2cd2-47a7-8876-7a4b563b131c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-quobyte-5c9684a8-2cd2-47a7-8876-7a4b563b131c" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-5c9684a8-2cd2-47a7-8876-7a4b563b131c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Deleting offline snapshot 5c9684a8-2cd2-47a7-8876-7a4b563b131c of volume f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] snapshot_file for this snap is: volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c39de90-d719-4ca3-b3f2-9f99356a087f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:54 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df" returned: 0 in 0.904s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:54 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df Jul 07 15:16:54 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:54 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c Jul 07 15:16:54 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:54 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.084s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:54 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Deleted volume successfully. Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f6078508-ada3-483f-8d07-d65ba014f34b tempest-VolumeQuotasNegativeTestJSON-2136340707 None] Lock "cinder-32273243-c6c0-422a-b033-3b7f3e9fb60e-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:55 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c" returned: 0 in 0.987s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7722f2-727c-4fcd-aef9-ae1f76b99fdf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:55 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c75765e-8e16-4c6b-ba94-8887d69623df" returned: 0 in 1.026s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Lock "cinder-quobyte-1c75765e-8e16-4c6b-ba94-8887d69623df" released by "delete_volume" :: held 2.001s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Acquiring lock "cinder-quobyte-b7441ba3-96ae-4cae-8185-937bddf90ab0" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Lock "cinder-quobyte-b7441ba3-96ae-4cae-8185-937bddf90ab0" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[164e8bd5-d52e-412d-8c75-89cb66884acd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:55 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c Jul 07 15:16:55 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:55 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 Jul 07 15:16:55 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:56 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" returned: 0 in 0.873s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:56 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c Jul 07 15:16:56 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:56 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0" returned: 0 in 0.888s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:56 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0 Jul 07 15:16:56 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:56 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c" returned: 0 in 0.810s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:56 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c Jul 07 15:16:56 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:56 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b7441ba3-96ae-4cae-8185-937bddf90ab0" returned: 0 in 0.731s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Lock "cinder-quobyte-b7441ba3-96ae-4cae-8185-937bddf90ab0" released by "delete_volume" :: held 1.667s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Created reservations ['50170ae0-919e-4ba4-92b9-1d2397b8f0c9'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:57 devstack cinder-volume[87257]: WARNING cinder.quota [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-11040995 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-11040995, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:16:57 devstack cinder-volume[87257]: WARNING cinder.quota [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-11040995 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-11040995, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Created reservations ['b0c34e54-a770-42ed-9fc6-0d63be5df407', '49c8ba90-a887-455f-977b-b7512331919f', 'da20661a-eb67-423a-b604-1eabc076aa2f', '84e0d15e-7b57-4ca0-bd2f-80c42a8af6d2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Created reservations ['6f8c306e-d782-4db2-9ba9-54e3181c4573', '2fdc703e-8ba0-4d83-876f-47709bcec0af', '8f66ae17-c5cd-43a7-8eb3-2269ae7d9bf8', '30c16e6e-495e-4045-a6cf-fd9596acc22c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:57 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:16:57 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:57 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c.5c9684a8-2cd2-47a7-8876-7a4b563b131c" returned: 0 in 0.786s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-5c9684a8-2cd2-47a7-8876-7a4b563b131c" released by "_delete_snapshot" :: held 3.584s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" released by "delete_snapshot" :: held 3.618s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Created reservations ['45146834-ccbe-4063-86f8-cd1374e17273', '88bc35ae-761f-4470-9324-1d742aec0006', '2a3b2d0a-083a-425c-8d32-b875149ba29a', '3abb19b0-3224-48e8-bd6d-e77a461191f1'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:16:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Delete snapshot completed successfully. Jul 07 15:16:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7da60ad4-db63-45aa-b268-c8f9d00b5608 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-5c9684a8-2cd2-47a7-8876-7a4b563b131c-delete_snapshot" released by "delete_snapshot" :: held 3.790s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:16:58 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.701s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:16:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-05474e32-11ad-4c34-adcf-c0611fe83658 tempest-GroupsTest-628932710 None] Delete group completed successfully. Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-f4b76924-61c5-4b90-8f72-b8c1d525fc0c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-f4b76924-61c5-4b90-8f72-b8c1d525fc0c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c522d65-5799-4acf-a428-1708eec75abc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:16:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:58 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c Jul 07 15:16:58 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:16:59 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 07 15:16:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" returned: 0 in 0.892s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:16:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:16:59 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c Jul 07 15:16:59 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:00 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:17:00 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:00 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" returned: 0 in 0.796s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-quobyte-f4b76924-61c5-4b90-8f72-b8c1d525fc0c" released by "delete_volume" :: held 1.771s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Created reservations ['64270025-29c7-4343-9f7e-de595df8b012', '731c2cfc-e42c-4332-b39b-aed5155bab22', '7338692d-f4aa-47d9-a228-9b4c32adf86b', 'c26c6525-de30-49e1-9c57-cd10f4d55180'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:00 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:17:00 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:00 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.811s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 8 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:17:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:17:01 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.811s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:17:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Deleted volume successfully. Jul 07 15:17:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1ad9ff29-6772-4f49-a887-ee2c3a204bd7 tempest-VolumesSnapshotListTestJSON-1264429752 None] Lock "cinder-f4b76924-61c5-4b90-8f72-b8c1d525fc0c-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-62c18631-6099-4618-939a-554abe63678e req-f55d9361-dc8e-4b33-82f8-c76a60405ac6 tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-62c18631-6099-4618-939a-554abe63678e req-f55d9361-dc8e-4b33-82f8-c76a60405ac6 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bdd7a8-cac1-4b8f-9c13-ddcbfdb81cb3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-62c18631-6099-4618-939a-554abe63678e req-f55d9361-dc8e-4b33-82f8-c76a60405ac6 tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:02 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed Jul 07 15:17:02 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:03 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-62c18631-6099-4618-939a-554abe63678e req-f55d9361-dc8e-4b33-82f8-c76a60405ac6 tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed" returned: 0 in 0.907s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-62c18631-6099-4618-939a-554abe63678e req-f55d9361-dc8e-4b33-82f8-c76a60405ac6 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.941s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-62c18631-6099-4618-939a-554abe63678e req-f55d9361-dc8e-4b33-82f8-c76a60405ac6 tempest-TestServerVolumeAttachmentScenario-956382829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-56faa102-3605-45da-b11b-4f293fad5eed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd35b6593-12cd-4544-a67e-a6f9e3b72d9c', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:17:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-62c18631-6099-4618-939a-554abe63678e req-f55d9361-dc8e-4b33-82f8-c76a60405ac6 tempest-TestServerVolumeAttachmentScenario-956382829 None] attachment_update completed successfully. Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Flow 'volume_create_manager' (9fcf9f96-de41-4fd8-bbfb-d1ace1448e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c5c40e-2368-4d28-8807-cddd98a697cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c5c40e-2368-4d28-8807-cddd98a697cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-877665303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886edc33-b82a-4087-b483-536d9cc2baf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c8f1d48237474488a0c1498c83c1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:07Z,use_quota=True,user_id='76be4665061a4b13a06cff4660c42efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deba00ac-3165-49f7-8a27-386f37685b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deba00ac-3165-49f7-8a27-386f37685b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49557dbb-77eb-46b9-b075-c5676fc5177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:07 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49557dbb-77eb-46b9-b075-c5676fc5177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '886edc33-b82a-4087-b483-536d9cc2baf8', 'volume_name': 'volume-886edc33-b82a-4087-b483-536d9cc2baf8', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf65534-acd2-49b5-b496-9b58688e7fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf65534-acd2-49b5-b496-9b58688e7fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac56759c-5d93-4c40-b19b-1f017a0199f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:08 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Volume 886edc33-b82a-4087-b483-536d9cc2baf8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-886edc33-b82a-4087-b483-536d9cc2baf8', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Trying to clone 886edc33-b82a-4087-b483-536d9cc2baf8 from image 7c780384-ba04-4889-abec-1e35c2057312 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:17:08 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Image download 20.69 MB at 20.69 MB/s Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c0de14-4a0e-4f66-a205-5911fa9c5d6f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:08 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD Jul 07 15:17:08 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:09 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD" returned: 0 in 1.001s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:09 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 is fetched for user 76be4665061a4b13a06cff4660c42efe. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:17:09 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00abc4a-f53b-4e9f-aade-287f3d44d1c8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:09 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD Jul 07 15:17:09 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:10 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD" returned: 0 in 1.021s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-877665303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886edc33-b82a-4087-b483-536d9cc2baf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c8f1d48237474488a0c1498c83c1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:07Z,use_quota=True,user_id='76be4665061a4b13a06cff4660c42efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Creating volume 886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:17:10 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:17:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:10 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 1073741824 Jul 07 15:17:10 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:11 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 1073741824" returned: 0 in 1.182s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:11 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 Jul 07 15:17:11 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:12 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8" returned: 0 in 1.068s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:17:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:13 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Attempting download of 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume 886edc33-b82a-4087-b483-536d9cc2baf8. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:17:13 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a7677-73a8-4903-8f04-38d42c4f84c1]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_vsy1t6_b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:13 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_vsy1t6_b Jul 07 15:17:13 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:14 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_vsy1t6_b" returned: 0 in 1.139s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_vsy1t6_b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:14 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_vsy1t6_b Jul 07 15:17:14 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:15 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_vsy1t6_b" returned: 1 in 0.908s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_vsy1t6_b' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:17:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbe3946-6d9d-45d3-8631-1263e71d59d3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:15 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD Jul 07 15:17:15 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:16 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:16 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] 7c780384-ba04-4889-abec-1e35c2057312 was qcow2, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:17:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:16 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 Jul 07 15:17:16 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-92000cbb-22a6-4332-a06a-fe19d42e3111 req-c1107d6f-a268-4a6d-bf26-f2fa6a454cb9 tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-92000cbb-22a6-4332-a06a-fe19d42e3111 req-c1107d6f-a268-4a6d-bf26-f2fa6a454cb9 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:17 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca355602-cf53-4eff-842a-3b1eba4b0ec2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-92000cbb-22a6-4332-a06a-fe19d42e3111 req-c1107d6f-a268-4a6d-bf26-f2fa6a454cb9 tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:17 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 Jul 07 15:17:17 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:18 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-92000cbb-22a6-4332-a06a-fe19d42e3111 req-c1107d6f-a268-4a6d-bf26-f2fa6a454cb9 tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339" returned: 0 in 1.012s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-92000cbb-22a6-4332-a06a-fe19d42e3111 req-c1107d6f-a268-4a6d-bf26-f2fa6a454cb9 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.049s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-92000cbb-22a6-4332-a06a-fe19d42e3111 req-c1107d6f-a268-4a6d-bf26-f2fa6a454cb9 tempest-TestServerVolumeAttachmentScenario-956382829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-889a4988-c9df-4bab-8da3-d7b9f0604339', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '622ea676-ad2b-445a-a486-116c2d22cc66', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:17:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-92000cbb-22a6-4332-a06a-fe19d42e3111 req-c1107d6f-a268-4a6d-bf26-f2fa6a454cb9 tempest-TestServerVolumeAttachmentScenario-956382829 None] attachment_update completed successfully. Jul 07 15:17:18 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8" returned: 0 in 2.436s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:18 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_7tmymafsdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:17:18 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Converted 112.00 MB image at 45.96 MB/s Jul 07 15:17:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:18 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 1G Jul 07 15:17:18 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:19 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 1G" returned: 0 in 0.852s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:19 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bde5210-dd03-4a85-8b96-ea1d2063532c]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:19 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 Jul 07 15:17:19 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:20 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8" returned: 0 in 0.877s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:20 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 Jul 07 15:17:20 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:21 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8" returned: 1 in 0.892s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Downloaded image 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume 886edc33-b82a-4087-b483-536d9cc2baf8 successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 for user 76be4665061a4b13a06cff4660c42efe is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Marking volume 886edc33-b82a-4087-b483-536d9cc2baf8 as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Copying metadata from image 7c780384-ba04-4889-abec-1e35c2057312 to 886edc33-b82a-4087-b483-536d9cc2baf8. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Creating volume glance metadata for volume 886edc33-b82a-4087-b483-536d9cc2baf8 backed by image 7c780384-ba04-4889-abec-1e35c2057312 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac56759c-5d93-4c40-b19b-1f017a0199f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886edc33-b82a-4087-b483-536d9cc2baf8', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d227aeb-6997-4484-b2a0-2c6547147785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Volume volume-886edc33-b82a-4087-b483-536d9cc2baf8 (886edc33-b82a-4087-b483-536d9cc2baf8): created successfully Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d227aeb-6997-4484-b2a0-2c6547147785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Flow 'volume_create_manager' (9fcf9f96-de41-4fd8-bbfb-d1ace1448e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:21 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-05f59495-4efd-4c95-92bc-01fbec431f98 tempest-VolumesImageMetadata-1036288083 None] Created volume successfully. Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Acquiring lock "cinder-886edc33-b82a-4087-b483-536d9cc2baf8-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Lock "cinder-886edc33-b82a-4087-b483-536d9cc2baf8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Acquiring lock "cinder-quobyte-886edc33-b82a-4087-b483-536d9cc2baf8" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Lock "cinder-quobyte-886edc33-b82a-4087-b483-536d9cc2baf8" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e159708-1497-4f25-8e49-ba4b17974a3b]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:22 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 Jul 07 15:17:22 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:23 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8" returned: 0 in 0.885s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:23 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 Jul 07 15:17:23 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:24 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8" returned: 1 in 1.222s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:17:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:24 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8 Jul 07 15:17:24 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=115,cinder:DELETE=8,cinder:SELECT=114,cinder:INSERT=31 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:17:25 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=115,cinder:INSERT=33,cinder:DELETE=7,cinder:SELECT=109 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886edc33-b82a-4087-b483-536d9cc2baf8" returned: 0 in 0.931s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Flow 'volume_create_manager' (a8e68126-391d-479e-a414-aa89d45df378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d66bf2-df0d-42d5-8f29-e4432ba59c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Lock "cinder-quobyte-886edc33-b82a-4087-b483-536d9cc2baf8" released by "delete_volume" :: held 3.198s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d66bf2-df0d-42d5-8f29-e4432ba59c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-535372319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af27bbc-08ae-4e15-af35-437888e8867b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27cdbe32ac345239fed6782de1e2b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:25Z,use_quota=True,user_id='b8877537603f41f98d67e98a84078749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bc11d3-8f3f-4b55-bfde-9aa478f5ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bc11d3-8f3f-4b55-bfde-9aa478f5ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94507fe3-abfb-414e-9497-727688dd4a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94507fe3-abfb-414e-9497-727688dd4a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af27bbc-08ae-4e15-af35-437888e8867b', 'volume_name': 'volume-8af27bbc-08ae-4e15-af35-437888e8867b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c25e15e-7f57-4b8d-a0f8-1b8f5b50cd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c25e15e-7f57-4b8d-a0f8-1b8f5b50cd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b96df6f-eefd-498e-bf8a-2fa882a78d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Volume 8af27bbc-08ae-4e15-af35-437888e8867b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af27bbc-08ae-4e15-af35-437888e8867b', 'volume_size': 1} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-535372319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af27bbc-08ae-4e15-af35-437888e8867b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27cdbe32ac345239fed6782de1e2b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:25Z,use_quota=True,user_id='b8877537603f41f98d67e98a84078749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Creating volume 8af27bbc-08ae-4e15-af35-437888e8867b {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:17:25 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:25 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b 1073741824 Jul 07 15:17:25 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-986fc8a4-1a4a-42cc-b241-e0c6cef18094 req-c2a635ca-1ad2-4507-8643-5187039aff84 tempest-TestServerVolumeAttachmentScenario-956382829 None] Terminate volume connection completed successfully. Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-986fc8a4-1a4a-42cc-b241-e0c6cef18094 req-c2a635ca-1ad2-4507-8643-5187039aff84 tempest-TestServerVolumeAttachmentScenario-956382829 None] Deleting attachment 622ea676-ad2b-445a-a486-116c2d22cc66. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Created reservations ['501e9400-deb1-458c-a4ba-c93632037404', 'd0ce9680-8e3c-4a5d-a135-f39a91104227', '2f6a8669-b0cb-4054-a50b-6f57f83f3164', 'fea0afcb-584a-44ec-9dff-82012a709a42'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:25 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:17:25 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:26 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:26 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:17:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Deleted volume successfully. Jul 07 15:17:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d47f736e-0a38-4b76-999e-8a53a0a90283 tempest-VolumesImageMetadata-1036288083 None] Lock "cinder-886edc33-b82a-4087-b483-536d9cc2baf8-delete_volume" released by "delete_volume" :: held 4.324s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:26 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b 1073741824" returned: 0 in 1.053s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:26 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b Jul 07 15:17:26 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:27 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b" returned: 0 in 0.947s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:17:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b96df6f-eefd-498e-bf8a-2fa882a78d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af27bbc-08ae-4e15-af35-437888e8867b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22157d2a-7a7c-4d64-a58e-bd8d5297da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Volume volume-8af27bbc-08ae-4e15-af35-437888e8867b (8af27bbc-08ae-4e15-af35-437888e8867b): created successfully Jul 07 15:17:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22157d2a-7a7c-4d64-a58e-bd8d5297da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Flow 'volume_create_manager' (a8e68126-391d-479e-a414-aa89d45df378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:27 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-570241a1-5142-4230-b4f1-a8deb3b7b852 tempest-VolumesServicesTestJSON-446257054 None] Created volume successfully. Jul 07 15:17:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Acquiring lock "cinder-8af27bbc-08ae-4e15-af35-437888e8867b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Lock "cinder-8af27bbc-08ae-4e15-af35-437888e8867b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Acquiring lock "cinder-quobyte-8af27bbc-08ae-4e15-af35-437888e8867b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Lock "cinder-quobyte-8af27bbc-08ae-4e15-af35-437888e8867b" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:28 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc91227-8cd8-438c-b96e-c5956bd6e4ef]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:28 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b Jul 07 15:17:28 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-d4a3bf50-8260-4249-a05f-86e75a3533e3 req-570e3361-c2ac-4e02-a033-9c0b4fcace11 tempest-TestServerVolumeAttachmentScenario-956382829 None] Terminate volume connection completed successfully. Jul 07 15:17:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-d4a3bf50-8260-4249-a05f-86e75a3533e3 req-570e3361-c2ac-4e02-a033-9c0b4fcace11 tempest-TestServerVolumeAttachmentScenario-956382829 None] Deleting attachment d35b6593-12cd-4544-a67e-a6f9e3b72d9c. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:17:29 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b" returned: 0 in 0.964s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:29 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b Jul 07 15:17:29 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Flow 'volume_create_manager' (b20a342d-dae5-4199-8a82-8fd7e41a3650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7da2574-0c4a-4699-98c8-03a095deedb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7da2574-0c4a-4699-98c8-03a095deedb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1290144360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2189ee7d-2ace-4df8-a623-41bd22017588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4352e9646d294ab3b1ad9c7b5ae0c42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:30Z,use_quota=True,user_id='4396066a2a434dfb9963d1e609a8305c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceb4ed4-cd69-4590-8e42-fb85fa8514e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceb4ed4-cd69-4590-8e42-fb85fa8514e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c043c946-6bab-439b-bc8a-45e04fbc6857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c043c946-6bab-439b-bc8a-45e04fbc6857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2189ee7d-2ace-4df8-a623-41bd22017588', 'volume_name': 'volume-2189ee7d-2ace-4df8-a623-41bd22017588', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc7178f-3362-47ba-ae29-09364cb48b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc7178f-3362-47ba-ae29-09364cb48b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d08c470-68ea-4787-9cd2-0a57029be3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:30 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Volume 2189ee7d-2ace-4df8-a623-41bd22017588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2189ee7d-2ace-4df8-a623-41bd22017588', 'volume_size': 1} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1290144360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2189ee7d-2ace-4df8-a623-41bd22017588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4352e9646d294ab3b1ad9c7b5ae0c42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:30Z,use_quota=True,user_id='4396066a2a434dfb9963d1e609a8305c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Creating volume 2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:17:30 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:30 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8af27bbc-08ae-4e15-af35-437888e8867b" returned: 0 in 0.814s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:30 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 1073741824 Jul 07 15:17:30 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Lock "cinder-quobyte-8af27bbc-08ae-4e15-af35-437888e8867b" released by "delete_volume" :: held 1.833s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Created reservations ['e15a5e0d-fec7-4dd4-93c1-3b4071eaa284', 'dd32400e-1618-49ad-9252-bb9fdca79e93', 'e93f8267-760f-40eb-b6b1-392bde87fdb0', '7fdfcd84-5de2-4b8a-aa51-0059cb6aef76'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:30 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:17:30 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:31 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:31 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:17:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Deleted volume successfully. Jul 07 15:17:31 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-36720171-a954-4637-b782-c2b7c9d48d8d tempest-VolumesServicesTestJSON-446257054 None] Lock "cinder-8af27bbc-08ae-4e15-af35-437888e8867b-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 1073741824" returned: 0 in 1.023s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:31 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 Jul 07 15:17:31 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:32 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:17:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d08c470-68ea-4787-9cd2-0a57029be3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2189ee7d-2ace-4df8-a623-41bd22017588', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cedfb4-1428-4c47-8bdf-43ecc53187bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Volume volume-2189ee7d-2ace-4df8-a623-41bd22017588 (2189ee7d-2ace-4df8-a623-41bd22017588): created successfully Jul 07 15:17:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cedfb4-1428-4c47-8bdf-43ecc53187bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Flow 'volume_create_manager' (b20a342d-dae5-4199-8a82-8fd7e41a3650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:32 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bab2a969-174f-4bbe-b15a-5711a3286137 tempest-SnapshotMetadataTestJSON-160637293 None] Created volume successfully. Jul 07 15:17:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Creating offline snapshot d4de0b63-26f5-4e32-8def-3774966cc3db of volume 2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:17:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3af32f-8a3a-425c-b98f-5bc0dd34007a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:34 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 Jul 07 15:17:34 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:34 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588" returned: 0 in 1.029s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:34 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db 1G Jul 07 15:17:34 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:35 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db 1G" returned: 0 in 0.957s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2189ee7d-2ace-4df8-a623-41bd22017588 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:35 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2189ee7d-2ace-4df8-a623-41bd22017588 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db Jul 07 15:17:35 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:36 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2189ee7d-2ace-4df8-a623-41bd22017588 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db" returned: 0 in 0.772s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:36 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db is being set with open permissions: ugo+rw Jul 07 15:17:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:36 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db Jul 07 15:17:36 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:37 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db" returned: 0 in 0.754s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:37 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.info Jul 07 15:17:37 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:38 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.info" returned: 0 in 0.981s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:38 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.info is being set with open permissions: ugo+rw Jul 07 15:17:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:38 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.info Jul 07 15:17:38 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:39 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.info" returned: 0 in 1.107s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.723s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-26987ce9-3208-42e9-bf27-b9330c1efbe0 tempest-SnapshotMetadataTestJSON-160637293 None] Create snapshot completed successfully Jul 07 15:17:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "cinder-889a4988-c9df-4bab-8da3-d7b9f0604339-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-889a4988-c9df-4bab-8da3-d7b9f0604339-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "cinder-quobyte-889a4988-c9df-4bab-8da3-d7b9f0604339" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-quobyte-889a4988-c9df-4bab-8da3-d7b9f0604339" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af531ee0-1f7e-4e68-b8f7-5461a2c4daef]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:40 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 Jul 07 15:17:40 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "cinder-d4de0b63-26f5-4e32-8def-3774966cc3db-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-d4de0b63-26f5-4e32-8def-3774966cc3db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "cinder-quobyte-2189ee7d-2ace-4df8-a623-41bd22017588" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-quobyte-2189ee7d-2ace-4df8-a623-41bd22017588" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "cinder-quobyte-d4de0b63-26f5-4e32-8def-3774966cc3db" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-quobyte-d4de0b63-26f5-4e32-8def-3774966cc3db" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Deleting offline snapshot d4de0b63-26f5-4e32-8def-3774966cc3db of volume 2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:17:41 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] snapshot_file for this snap is: volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339" returned: 0 in 1.028s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7e408b-7d9a-4be7-832c-1b827e7906ba]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:41 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339 Jul 07 15:17:41 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:41 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db Jul 07 15:17:41 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:42 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-889a4988-c9df-4bab-8da3-d7b9f0604339" returned: 0 in 0.865s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-quobyte-889a4988-c9df-4bab-8da3-d7b9f0604339" released by "delete_volume" :: held 1.968s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Created reservations ['f69f6f81-df18-4a6f-b525-95cdbf7881f5', 'c3bb0ef1-c343-4189-b30d-5cc0fc81d468', '29241d7a-f5a6-4bcf-a783-ade3e869f152', 'e18f0682-2fc2-4465-8846-ef4cd572fa16'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:42 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db" returned: 0 in 1.023s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2189ee7d-2ace-4df8-a623-41bd22017588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:17:42 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:17:42 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[add4cb61-56cb-413c-bee6-121c2f286750]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "cinder-56faa102-3605-45da-b11b-4f293fad5eed-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-56faa102-3605-45da-b11b-4f293fad5eed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:42 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 Jul 07 15:17:42 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "cinder-quobyte-56faa102-3605-45da-b11b-4f293fad5eed" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-quobyte-56faa102-3605-45da-b11b-4f293fad5eed" acquired by "delete_volume" :: waited 0.036s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca5519-9582-4a59-9a81-38b931934c11]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:42 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed Jul 07 15:17:42 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:43 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.019s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:43 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:17:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Deleted volume successfully. Jul 07 15:17:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7f87026d-52ec-4967-9dab-91079a131cf0 tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-889a4988-c9df-4bab-8da3-d7b9f0604339-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:43 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588" returned: 0 in 1.198s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:43 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db Jul 07 15:17:43 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:44 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed" returned: 0 in 1.385s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:44 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed Jul 07 15:17:44 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Flow 'volume_create_manager' (3c7b1ede-fe54-4a87-ad35-dfab9ee331ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324ed68-5069-42b1-bac3-756e9c7b1956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324ed68-5069-42b1-bac3-756e9c7b1956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-550478243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4432d6e-84b9-45cc-b624-b16c6056457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb74bb0c77a4742a8a4415bf967057d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:45Z,use_quota=True,user_id='4efadd64672e4806aa20141c44a94cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437dd996-a974-4a78-8911-3b8a79bd5bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437dd996-a974-4a78-8911-3b8a79bd5bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f0a314-c644-4151-afb8-d5786e9dbefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f0a314-c644-4151-afb8-d5786e9dbefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4432d6e-84b9-45cc-b624-b16c6056457b', 'volume_name': 'volume-a4432d6e-84b9-45cc-b624-b16c6056457b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20040c9e-769d-4ff0-ac39-03c6aba4c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20040c9e-769d-4ff0-ac39-03c6aba4c72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20961de8-818c-46b9-bea5-47eac29d4577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Volume a4432d6e-84b9-45cc-b624-b16c6056457b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4432d6e-84b9-45cc-b624-b16c6056457b', 'volume_size': 1} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-550478243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4432d6e-84b9-45cc-b624-b16c6056457b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb74bb0c77a4742a8a4415bf967057d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:45Z,use_quota=True,user_id='4efadd64672e4806aa20141c44a94cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Creating volume a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:17:44 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:44 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b 1073741824 Jul 07 15:17:44 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:44 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db" returned: 0 in 1.159s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:44 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db Jul 07 15:17:44 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:45 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56faa102-3605-45da-b11b-4f293fad5eed" returned: 0 in 0.937s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-quobyte-56faa102-3605-45da-b11b-4f293fad5eed" released by "delete_volume" :: held 2.384s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Created reservations ['a8bbf6d5-00b8-4ced-b745-dd2fbb5a075e', 'a3caccda-8fc4-4e0e-aee2-ad2f44904e66', 'd0242604-64be-4ccd-9b05-0070ee720da9', 'e78031ac-8235-4133-b200-addd6da21fe1'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:45 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:17:45 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:45 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b 1073741824" returned: 0 in 1.024s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:45 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588.d4de0b63-26f5-4e32-8def-3774966cc3db" returned: 0 in 0.901s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-quobyte-d4de0b63-26f5-4e32-8def-3774966cc3db" released by "_delete_snapshot" :: held 4.426s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-quobyte-2189ee7d-2ace-4df8-a623-41bd22017588" released by "delete_snapshot" :: held 4.471s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:45 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b Jul 07 15:17:45 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:45 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Created reservations ['6840e3da-05aa-4d76-bf20-f1577bed685b', '7733ac23-b50b-4b7f-a1d2-fdcc3b50c7ef', '879e18d8-c922-450d-a5b4-50fb1adfaf54', 'd491ef24-31fd-4afc-a44f-9cb91d8a041c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:17:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Delete snapshot completed successfully. Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7d71a0de-8552-4624-9a6d-6357cf455d12 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-d4de0b63-26f5-4e32-8def-3774966cc3db-delete_snapshot" released by "delete_snapshot" :: held 4.703s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:46 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.904s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:17:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Deleted volume successfully. Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bee2e191-740b-4862-ab00-8b3cedfdaf6c tempest-TestServerVolumeAttachmentScenario-956382829 None] Lock "cinder-56faa102-3605-45da-b11b-4f293fad5eed-delete_volume" released by "delete_volume" :: held 3.689s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:46 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b" returned: 0 in 0.981s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20961de8-818c-46b9-bea5-47eac29d4577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4432d6e-84b9-45cc-b624-b16c6056457b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b477e7a5-63c1-40df-895d-0211ba372a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "cinder-2189ee7d-2ace-4df8-a623-41bd22017588-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Volume volume-a4432d6e-84b9-45cc-b624-b16c6056457b (a4432d6e-84b9-45cc-b624-b16c6056457b): created successfully Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b477e7a5-63c1-40df-895d-0211ba372a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Flow 'volume_create_manager' (3c7b1ede-fe54-4a87-ad35-dfab9ee331ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-2189ee7d-2ace-4df8-a623-41bd22017588-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f21ede44-59c1-4488-bbd2-3db28ffddbd5 tempest-VolumesDeleteCascade-799668294 None] Created volume successfully. Jul 07 15:17:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "cinder-quobyte-2189ee7d-2ace-4df8-a623-41bd22017588" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:17:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-quobyte-2189ee7d-2ace-4df8-a623-41bd22017588" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:17:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0172a402-71ed-43b6-9157-1730908d3acb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:47 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 Jul 07 15:17:47 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:48 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588" returned: 0 in 0.950s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:48 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588 Jul 07 15:17:48 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Creating offline snapshot 72fd6b5d-d36d-43c5-b912-caaa3681bec7 of volume a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:17:48 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[323e94ef-fbf9-409b-92a3-039b36816d8b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:48 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b Jul 07 15:17:48 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:49 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2189ee7d-2ace-4df8-a623-41bd22017588" returned: 0 in 1.128s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-quobyte-2189ee7d-2ace-4df8-a623-41bd22017588" released by "delete_volume" :: held 2.199s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Created reservations ['ac740f4c-4426-44bf-bed8-a691201e40fb', '403a8812-87c4-4748-a1a7-42d2a05e07d4', 'fa0f3a94-3a97-43b0-9206-eb4569fde691', '4d88daac-0426-44d1-9716-86c0e8251f0c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:49 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:17:49 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:49 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b" returned: 0 in 1.320s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:49 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 1G Jul 07 15:17:49 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:50 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.175s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:50 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:17:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Deleted volume successfully. Jul 07 15:17:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0645124c-84a8-43ce-8314-5ac8376a7a64 tempest-SnapshotMetadataTestJSON-160637293 None] Lock "cinder-2189ee7d-2ace-4df8-a623-41bd22017588-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:17:51 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 1G" returned: 0 in 1.583s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:51 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 Jul 07 15:17:51 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:52 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7" returned: 0 in 0.942s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:52 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 is being set with open permissions: ugo+rw Jul 07 15:17:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:52 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 Jul 07 15:17:52 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:53 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7" returned: 0 in 1.046s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:53 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.info Jul 07 15:17:53 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:54 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.info" returned: 0 in 0.871s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:54 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.info is being set with open permissions: ugo+rw Jul 07 15:17:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:54 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.info Jul 07 15:17:54 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:55 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.info" returned: 0 in 0.986s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.886s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:17:55 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2662703e-bd37-4ec2-8fd4-2c2d13016c42 tempest-VolumesDeleteCascade-799668294 None] Create snapshot completed successfully Jul 07 15:17:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:17:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Creating offline snapshot c89c85a7-43ba-4ec7-a7b0-c7aaba070737 of volume a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:17:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6b2fd9-93b4-420b-bb75-6790412d3eb8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:17:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:56 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 Jul 07 15:17:56 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:57 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7" returned: 0 in 1.224s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4432d6e-84b9-45cc-b624-b16c6056457b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:57 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 1G Jul 07 15:17:57 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Flow 'volume_create_manager' (d145a7b5-c104-486f-82ca-573544f9f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6777bdff-f66f-4b83-a6de-e93310eb6c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6777bdff-f66f-4b83-a6de-e93310eb6c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1583169688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716b980d-226d-48df-9283-28269f416573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fcf1ed75d14fafbcf3f0f4f41c176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:58Z,use_quota=True,user_id='378bd2a0e4ae4d0b87abe3f5a13daae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4e2aed-c69d-43e9-9364-2d94c2824394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4e2aed-c69d-43e9-9364-2d94c2824394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2c98da-84cb-4905-862a-6dde52d856c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2c98da-84cb-4905-862a-6dde52d856c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716b980d-226d-48df-9283-28269f416573', 'volume_name': 'volume-716b980d-226d-48df-9283-28269f416573', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77e012f-a57c-4a13-9385-cf166b4abb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77e012f-a57c-4a13-9385-cf166b4abb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfa0dd0-ff20-4075-b2e1-947869c6dd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:17:57 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Volume 716b980d-226d-48df-9283-28269f416573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716b980d-226d-48df-9283-28269f416573', 'volume_size': 1} Jul 07 15:17:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:17:58 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 1G" returned: 0 in 1.124s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:58 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 Jul 07 15:17:58 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:59 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:59 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 is being set with open permissions: ugo+rw Jul 07 15:17:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:17:59 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 Jul 07 15:17:59 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:17:59 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 07 15:17:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737" returned: 0 in 0.632s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:17:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.860s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.304s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1583169688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716b980d-226d-48df-9283-28269f416573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fcf1ed75d14fafbcf3f0f4f41c176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:17:58Z,use_quota=True,user_id='378bd2a0e4ae4d0b87abe3f5a13daae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Creating volume 716b980d-226d-48df-9283-28269f416573 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:00 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:00 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 1073741824 Jul 07 15:18:00 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:00 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:00 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b6b24253-21e4-4da1-9fd4-e43ba9a93723 tempest-VolumesDeleteCascade-799668294 None] Create snapshot completed successfully Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-a4432d6e-84b9-45cc-b624-b16c6056457b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-a4432d6e-84b9-45cc-b624-b16c6056457b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Performing cascade delete. {{(pid=87257) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-72fd6b5d-d36d-43c5-b912-caaa3681bec7-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-72fd6b5d-d36d-43c5-b912-caaa3681bec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-72fd6b5d-d36d-43c5-b912-caaa3681bec7" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-72fd6b5d-d36d-43c5-b912-caaa3681bec7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Deleting offline snapshot 72fd6b5d-d36d-43c5-b912-caaa3681bec7 of volume a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] snapshot_file for this snap is: volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b291dbb9-4ff4-4187-be7b-0d067fab1e73]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:00 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 Jul 07 15:18:00 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:00 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.897s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 28 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:18:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:18:01 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 1073741824" returned: 0 in 1.127s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:01 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 Jul 07 15:18:01 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:01 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7" returned: 0 in 0.925s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4432d6e-84b9-45cc-b624-b16c6056457b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf8c258-5954-47cd-bb78-4dc5944874ca]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:01 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b Jul 07 15:18:01 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:01 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573" returned: 0 in 0.727s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfa0dd0-ff20-4075-b2e1-947869c6dd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716b980d-226d-48df-9283-28269f416573', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01f22d4-cb41-4dbc-93a2-84acc70e5436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:01 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Volume volume-716b980d-226d-48df-9283-28269f416573 (716b980d-226d-48df-9283-28269f416573): created successfully Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01f22d4-cb41-4dbc-93a2-84acc70e5436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Flow 'volume_create_manager' (d145a7b5-c104-486f-82ca-573544f9f146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d3c9219f-87dd-4fcc-8127-3ce004235595 tempest-VolumesTransfersV357Test-406519467 None] Created volume successfully. Jul 07 15:18:02 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b" returned: 0 in 0.804s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db37ac-d70b-4563-b2ee-19f1fd338e0a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:02 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 Jul 07 15:18:02 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:03 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737" returned: 0 in 0.794s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4432d6e-84b9-45cc-b624-b16c6056457b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:18:03 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4fe866-d9e6-4a02-9986-30bfe8c646f8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:03 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 Jul 07 15:18:03 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-eeb109c5-28ee-4460-a532-42676507f51b tempest-VolumesTransfersV357Test-174999200 None] Transfer volume completed successfully. Jul 07 15:18:04 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7" returned: 0 in 0.860s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4432d6e-84b9-45cc-b624-b16c6056457b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:18:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c72d061-2f42-49d0-a79a-2236300b427b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:04 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b Jul 07 15:18:04 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Acquiring lock "cinder-716b980d-226d-48df-9283-28269f416573-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-716b980d-226d-48df-9283-28269f416573-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Acquiring lock "cinder-quobyte-716b980d-226d-48df-9283-28269f416573" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-quobyte-716b980d-226d-48df-9283-28269f416573" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6750aec0-04ab-4f34-9e38-9cfb1f92cd45]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:05 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 Jul 07 15:18:05 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:05 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b" returned: 0 in 1.261s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:05 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 Jul 07 15:18:05 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:06 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7" returned: 0 in 0.860s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:06 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7 Jul 07 15:18:06 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:06 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573" returned: 0 in 1.109s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:06 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573 Jul 07 15:18:06 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:07 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.72fd6b5d-d36d-43c5-b912-caaa3681bec7" returned: 0 in 0.699s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 -F qcow2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:07 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 -F qcow2 Jul 07 15:18:07 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:07 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-716b980d-226d-48df-9283-28269f416573" returned: 0 in 0.730s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-quobyte-716b980d-226d-48df-9283-28269f416573" released by "delete_volume" :: held 1.910s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Created reservations ['e6d02bdd-50b9-4283-a3fe-71d3048ad7a0', 'fc6d7749-b29e-4cb0-8b27-4fed9544fbe2', '806604fb-4cb8-47d1-bb97-ffc4586a7e07', '8c4fa4b8-5cdb-42ff-b013-61f60a8d203d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:07 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:07 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:07 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4432d6e-84b9-45cc-b624-b16c6056457b /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 -F qcow2" returned: 0 in 0.873s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-72fd6b5d-d36d-43c5-b912-caaa3681bec7" released by "_delete_snapshot" :: held 7.302s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" released by "delete_snapshot" :: held 7.334s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:08 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.823s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Created reservations ['a9c477e8-8638-4f3d-a7ce-90f26cfa1d13', 'cf8b3941-00d1-4ca0-9919-5d5ed4edb740', 'ea3e02d5-4aab-4cb6-8959-44f4bb785045', 'e94b16c4-a9fd-4fcd-a694-45b24d3040c5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:08 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Deleted volume successfully. Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f421e0e0-dd0b-49cd-9993-207652e96867 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-716b980d-226d-48df-9283-28269f416573-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Flow 'volume_create_manager' (5b0f3d71-5ecd-4474-bd67-df6cd7348839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d36da3-6e88-4e7c-bb70-d0f49b0d0f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:08 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Delete snapshot completed successfully. Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-72fd6b5d-d36d-43c5-b912-caaa3681bec7-delete_snapshot" released by "delete_snapshot" :: held 7.673s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-c89c85a7-43ba-4ec7-a7b0-c7aaba070737-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d36da3-6e88-4e7c-bb70-d0f49b0d0f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1877612686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad6ef85-1d9d-44ea-8e20-537214b15a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fcf1ed75d14fafbcf3f0f4f41c176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:08Z,use_quota=True,user_id='378bd2a0e4ae4d0b87abe3f5a13daae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977dfaec-e12a-42ac-b009-815ca7dac211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977dfaec-e12a-42ac-b009-815ca7dac211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838d3690-deb1-4923-a8dc-330cc6f46ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838d3690-deb1-4923-a8dc-330cc6f46ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad6ef85-1d9d-44ea-8e20-537214b15a32', 'volume_name': 'volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872f1bd7-eaf2-4cc2-823b-47bc7faad77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872f1bd7-eaf2-4cc2-823b-47bc7faad77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278f34af-ddfa-41b0-9dc6-49639a63b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:08 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Volume 4ad6ef85-1d9d-44ea-8e20-537214b15a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32', 'volume_size': 1} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1877612686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad6ef85-1d9d-44ea-8e20-537214b15a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fcf1ed75d14fafbcf3f0f4f41c176a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:08Z,use_quota=True,user_id='378bd2a0e4ae4d0b87abe3f5a13daae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Creating volume 4ad6ef85-1d9d-44ea-8e20-537214b15a32 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:08 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-c89c85a7-43ba-4ec7-a7b0-c7aaba070737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:08 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 1073741824 Jul 07 15:18:08 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-c89c85a7-43ba-4ec7-a7b0-c7aaba070737" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-c89c85a7-43ba-4ec7-a7b0-c7aaba070737" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Deleting offline snapshot c89c85a7-43ba-4ec7-a7b0-c7aaba070737 of volume a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] snapshot_file for this snap is: volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eddd35-98b4-44a3-bf73-e432a68db083]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:08 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 Jul 07 15:18:08 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:09 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737" returned: 0 in 0.838s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4432d6e-84b9-45cc-b624-b16c6056457b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:18:09 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 1073741824" returned: 0 in 0.976s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:09 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23aa00d-8be6-461a-95e3-e3b147156d62]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:09 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 Jul 07 15:18:09 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:09 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b Jul 07 15:18:09 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:10 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32" returned: 0 in 0.721s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278f34af-ddfa-41b0-9dc6-49639a63b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da18fa10-106f-4e6f-aaa0-6f9f63d73491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:10 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Volume volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 (4ad6ef85-1d9d-44ea-8e20-537214b15a32): created successfully Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da18fa10-106f-4e6f-aaa0-6f9f63d73491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Flow 'volume_create_manager' (5b0f3d71-5ecd-4474-bd67-df6cd7348839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f7f93d7b-629e-4598-9889-ef6fc220739d tempest-VolumesTransfersV357Test-406519467 None] Created volume successfully. Jul 07 15:18:10 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b" returned: 0 in 0.917s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:10 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 Jul 07 15:18:10 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Acquiring lock "cinder-4ad6ef85-1d9d-44ea-8e20-537214b15a32-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-4ad6ef85-1d9d-44ea-8e20-537214b15a32-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Acquiring lock "cinder-quobyte-4ad6ef85-1d9d-44ea-8e20-537214b15a32" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-quobyte-4ad6ef85-1d9d-44ea-8e20-537214b15a32" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0df8ac-9ab6-416c-8d15-b837bd299af5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:11 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 Jul 07 15:18:11 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:11 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737" returned: 0 in 1.093s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:11 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737 Jul 07 15:18:11 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:12 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b.c89c85a7-43ba-4ec7-a7b0-c7aaba070737" returned: 0 in 0.737s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:12 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32" returned: 0 in 1.143s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-c89c85a7-43ba-4ec7-a7b0-c7aaba070737" released by "_delete_snapshot" :: held 3.716s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" released by "delete_snapshot" :: held 3.749s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:12 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32 Jul 07 15:18:12 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Flow 'volume_create_manager' (56555914-710b-4b71-b006-2c7673cda12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e48ca36-9a85-4038-94f9-e72e90a18367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e48ca36-9a85-4038-94f9-e72e90a18367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1536290224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf26300-92ab-484d-80d7-e53cd3324e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fb402195e0470fab16f52adb079f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:12Z,use_quota=True,user_id='b8edafcca2e34a8894adb0f52d75cadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5e8bec-56fe-4f9a-914f-e471f017a08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5e8bec-56fe-4f9a-914f-e471f017a08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb78e1b4-f38b-4557-84da-7f13ac57b41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb78e1b4-f38b-4557-84da-7f13ac57b41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf26300-92ab-484d-80d7-e53cd3324e33', 'volume_name': 'volume-0cf26300-92ab-484d-80d7-e53cd3324e33', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2070edca-e479-463e-8dbf-744266fd032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2070edca-e479-463e-8dbf-744266fd032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310992d0-a2a7-4068-b20b-6cf7317c9b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:12 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Volume 0cf26300-92ab-484d-80d7-e53cd3324e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf26300-92ab-484d-80d7-e53cd3324e33', 'volume_size': 1} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1536290224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf26300-92ab-484d-80d7-e53cd3324e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fb402195e0470fab16f52adb079f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:12Z,use_quota=True,user_id='b8edafcca2e34a8894adb0f52d75cadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Creating volume 0cf26300-92ab-484d-80d7-e53cd3324e33 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:12 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:12 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 1073741824 Jul 07 15:18:12 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Created reservations ['9fb06d82-1b4b-406f-86b0-ab1af2f1db2a', '68b1d0f8-5bbd-49b7-a704-6a2c1c34c477', 'e7475a4a-e8e3-450c-a5a5-30ab430ee179', 'ba81c9f1-006f-404e-b728-0214ad9ca645'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:12 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Delete snapshot completed successfully. Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-c89c85a7-43ba-4ec7-a7b0-c7aaba070737-delete_snapshot" released by "delete_snapshot" :: held 4.060s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Snapshots deleted, issuing volume delete {{(pid=87257) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a1b16c-a715-4d8f-baf2-d7c5efc95d23]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:12 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b Jul 07 15:18:12 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:12 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4ad6ef85-1d9d-44ea-8e20-537214b15a32" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-quobyte-4ad6ef85-1d9d-44ea-8e20-537214b15a32" released by "delete_volume" :: held 2.007s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Created reservations ['9983da33-35d1-4e50-b49f-9922bb5f79e0', 'f84f36f5-c954-4046-92af-aaf5d8a3dbf4', '06b06b06-c71c-4193-a4bc-57a5bd662459', '5cf4097c-a370-495c-88c1-046926be6df2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:13 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:13 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:13 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 1073741824" returned: 0 in 1.116s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:13 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b" returned: 0 in 0.940s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:13 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 Jul 07 15:18:13 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:13 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b Jul 07 15:18:13 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:13 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.738s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Deleted volume successfully. Jul 07 15:18:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-52cb9ff3-179d-4f7d-9479-a63da06e93b3 tempest-VolumesTransfersV357Test-650618493 None] Lock "cinder-4ad6ef85-1d9d-44ea-8e20-537214b15a32-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:14 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a4432d6e-84b9-45cc-b624-b16c6056457b" returned: 0 in 0.774s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-a4432d6e-84b9-45cc-b624-b16c6056457b" released by "delete_volume" :: held 1.794s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:14 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33" returned: 0 in 0.877s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310992d0-a2a7-4068-b20b-6cf7317c9b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf26300-92ab-484d-80d7-e53cd3324e33', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17d169a-d363-4f66-8cb5-69f46760ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Created reservations ['e668e318-de65-411a-9e2d-6ed1cb8614cc', 'f5fd75dd-a0b0-4d6a-bb9e-5c657dc0832e', '444040a6-5922-43a1-9fc9-de5187b326ca', '47b911c6-a8ae-4a79-ac3e-58600e396284'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Volume volume-0cf26300-92ab-484d-80d7-e53cd3324e33 (0cf26300-92ab-484d-80d7-e53cd3324e33): created successfully Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17d169a-d363-4f66-8cb5-69f46760ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Flow 'volume_create_manager' (56555914-710b-4b71-b006-2c7673cda12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:14 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0628fcca-5dbc-4133-8891-704e8ce60271 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Created volume successfully. Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:14 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:14 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:15 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.757s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Deleted volume successfully. Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-542593b0-4337-430f-b4ff-161d8f165683 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-a4432d6e-84b9-45cc-b624-b16c6056457b-delete_volume" released by "delete_volume" :: held 14.756s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Flow 'volume_create_manager' (6cfe47e0-b319-4e09-8d01-52c5179a2876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7dd224-bb20-4ccc-bcc7-c89a4c5d01d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7dd224-bb20-4ccc-bcc7-c89a4c5d01d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1300440945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dec4b0f-72d2-4940-b0ac-feec6108bd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb74bb0c77a4742a8a4415bf967057d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:15Z,use_quota=True,user_id='4efadd64672e4806aa20141c44a94cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5829a039-abeb-4fea-8cf7-65065054d3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5829a039-abeb-4fea-8cf7-65065054d3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf58ab4-4b02-43fe-b766-04046ac5e1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf58ab4-4b02-43fe-b766-04046ac5e1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dec4b0f-72d2-4940-b0ac-feec6108bd09', 'volume_name': 'volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3397b99-8a7d-426a-95a2-81b6c1a8e409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3397b99-8a7d-426a-95a2-81b6c1a8e409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0016a5-09e1-45d8-b24d-f9e7dcacab09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:15 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Volume 6dec4b0f-72d2-4940-b0ac-feec6108bd09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09', 'volume_size': 1} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1300440945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dec4b0f-72d2-4940-b0ac-feec6108bd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb74bb0c77a4742a8a4415bf967057d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:15Z,use_quota=True,user_id='4efadd64672e4806aa20141c44a94cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Creating volume 6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:15 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:18:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:15 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 1073741824 Jul 07 15:18:15 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:16 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 1073741824" returned: 0 in 0.944s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:16 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 Jul 07 15:18:16 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:17 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09" returned: 0 in 0.753s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0016a5-09e1-45d8-b24d-f9e7dcacab09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d55b916-d0c2-42a8-86ff-56aeff873188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:17 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Volume volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 (6dec4b0f-72d2-4940-b0ac-feec6108bd09): created successfully Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d55b916-d0c2-42a8-86ff-56aeff873188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Flow 'volume_create_manager' (6cfe47e0-b319-4e09-8d01-52c5179a2876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:17 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f3acf20b-c7a2-4971-85fc-982abcb9a605 tempest-VolumesDeleteCascade-799668294 None] Created volume successfully. Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Creating offline snapshot eb1faf28-9787-40b1-bba9-94ca836ada1d of volume 6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ca36c6-06cc-46b1-847f-bf4fac0535fb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:17 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 Jul 07 15:18:17 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-f1c6ecc0-42b6-41a6-87a7-66b150f15f97 req-8dd56f97-7aa8-4a25-83d9-607188bcb899 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:18 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09" returned: 0 in 1.086s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:18 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d 1G Jul 07 15:18:18 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:19 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d 1G" returned: 0 in 1.057s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:19 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d Jul 07 15:18:19 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:20 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d" returned: 0 in 0.748s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:20 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d is being set with open permissions: ugo+rw Jul 07 15:18:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:20 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d Jul 07 15:18:20 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:21 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d" returned: 0 in 0.816s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:21 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.info Jul 07 15:18:21 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:22 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.info" returned: 0 in 0.876s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:22 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.info is being set with open permissions: ugo+rw Jul 07 15:18:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:22 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.info Jul 07 15:18:22 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:23 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.info" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.477s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-f1c6ecc0-42b6-41a6-87a7-66b150f15f97 req-8dd56f97-7aa8-4a25-83d9-607188bcb899 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.459s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8611279e-1ad4-40bf-8529-1ad8a127f564]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-f1c6ecc0-42b6-41a6-87a7-66b150f15f97 req-8dd56f97-7aa8-4a25-83d9-607188bcb899 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-04e5358e-a9fc-4c32-a1ea-8181e5efc566 tempest-VolumesDeleteCascade-799668294 None] Create snapshot completed successfully Jul 07 15:18:23 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 Jul 07 15:18:23 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Flow 'volume_create_manager' (98ac14d1-7f07-43e4-adf2-0473c8636956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18df0a2e-77a7-4537-9a5a-301aec0171e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18df0a2e-77a7-4537-9a5a-301aec0171e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-651982285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe3885c-050e-4937-8ceb-5af03355c0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2e6555c2ee40d7b403d68c7bd0bf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:23Z,use_quota=True,user_id='927d1f0bb7884a1c968d937df5d076f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfdaa56-b5e0-4b7c-842c-1c44ae3f7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfdaa56-b5e0-4b7c-842c-1c44ae3f7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f4fd2e-2787-4217-8387-35fbad41d071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f4fd2e-2787-4217-8387-35fbad41d071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dbe3885c-050e-4937-8ceb-5af03355c0c4', 'volume_name': 'volume-dbe3885c-050e-4937-8ceb-5af03355c0c4', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf242346-5153-4a41-82c7-4cd3ec14e24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf242346-5153-4a41-82c7-4cd3ec14e24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67aeeaf8-a6bc-4e79-be34-4b348b8d2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Volume dbe3885c-050e-4937-8ceb-5af03355c0c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dbe3885c-050e-4937-8ceb-5af03355c0c4', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 15:18:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Trying to clone dbe3885c-050e-4937-8ceb-5af03355c0c4 from image 7c780384-ba04-4889-abec-1e35c2057312 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:18:24 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-f1c6ecc0-42b6-41a6-87a7-66b150f15f97 req-8dd56f97-7aa8-4a25-83d9-607188bcb899 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33" returned: 0 in 1.083s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-f1c6ecc0-42b6-41a6-87a7-66b150f15f97 req-8dd56f97-7aa8-4a25-83d9-607188bcb899 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.114s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Flow 'volume_create_manager' (d553a986-3e78-4c27-8bc6-51544348635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b3305-4f7b-4feb-bd9f-0eed7714158e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-f1c6ecc0-42b6-41a6-87a7-66b150f15f97 req-8dd56f97-7aa8-4a25-83d9-607188bcb899 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-0cf26300-92ab-484d-80d7-e53cd3324e33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82035d9d-0108-4648-b73d-142d13528d00', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b3305-4f7b-4feb-bd9f-0eed7714158e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-432298840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff646ed-e062-4264-86ba-b99fa775f608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb74bb0c77a4742a8a4415bf967057d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb1faf28-9787-40b1-bba9-94ca836ada1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:24Z,use_quota=True,user_id='4efadd64672e4806aa20141c44a94cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7363ee-7d4b-4109-aa5c-0a183e418cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7363ee-7d4b-4109-aa5c-0a183e418cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a9ba73-4fc6-451a-91a5-625819b587ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a9ba73-4fc6-451a-91a5-625819b587ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ff646ed-e062-4264-86ba-b99fa775f608', 'volume_name': 'volume-3ff646ed-e062-4264-86ba-b99fa775f608', 'volume_size': 1, 'snapshot_id': 'eb1faf28-9787-40b1-bba9-94ca836ada1d'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14d897a-e96b-4b81-b17e-d00d280016a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14d897a-e96b-4b81-b17e-d00d280016a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d89a5d-e5fb-464a-81bb-94f1fea3545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Volume 3ff646ed-e062-4264-86ba-b99fa775f608: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ff646ed-e062-4264-86ba-b99fa775f608', 'volume_size': 1, 'snapshot_id': 'eb1faf28-9787-40b1-bba9-94ca836ada1d'} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:18:24 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Image download 20.69 MB at 20.69 MB/s Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-eb1faf28-9787-40b1-bba9-94ca836ada1d-3ff646ed-e062-4264-86ba-b99fa775f608" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-eb1faf28-9787-40b1-bba9-94ca836ada1d-3ff646ed-e062-4264-86ba-b99fa775f608" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Creating volume 3ff646ed-e062-4264-86ba-b99fa775f608 from snapshot eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-3ff646ed-e062-4264-86ba-b99fa775f608" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-3ff646ed-e062-4264-86ba-b99fa775f608" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] snapshot: eb1faf28-9787-40b1-bba9-94ca836ada1d, volume: 3ff646ed-e062-4264-86ba-b99fa775f608, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce053bc6-9571-4988-ae72-bd05ad9585ab]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-f1c6ecc0-42b6-41a6-87a7-66b150f15f97 req-8dd56f97-7aa8-4a25-83d9-607188bcb899 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] attachment_update completed successfully. Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba082ccc-815e-4ef3-9dd4-78fe0d6898e1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:24 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD Jul 07 15:18:24 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:24 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d Jul 07 15:18:24 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:25 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD" returned: 0 in 0.990s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 is fetched for user 927d1f0bb7884a1c968d937df5d076f7. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=93,cinder:INSERT=23,cinder:UPDATE=109,cinder:DELETE=14 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=95,cinder:INSERT=31,cinder:UPDATE=109,cinder:DELETE=5 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4ee1fc-7b48-48a6-8748-218835a9413b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:25 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d" returned: 0 in 1.064s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbacf37-262b-4305-8f0f-85574bd60ad9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:25 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD Jul 07 15:18:25 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:25 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 Jul 07 15:18:25 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:26 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:26 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09" returned: 0 in 0.968s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:26 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:18:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:26 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 Jul 07 15:18:26 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Flow 'volume_create_manager' (d1296da5-d3b2-4ac8-ae92-0d75ef9079f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a40d03-d5ba-4616-ac8a-bdca7a70e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a40d03-d5ba-4616-ac8a-bdca7a70e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1436691059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd02df2f-b59a-4934-a86c-286164078589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc817e39ed24dd8b8e2dd44cc728c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:27Z,use_quota=True,user_id='c266fbb79aae43be91c7dda7f1e2abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24837510-9b37-4d92-8efc-87563216611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24837510-9b37-4d92-8efc-87563216611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbebbcae-7733-459d-9dab-c5eb8d871a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbebbcae-7733-459d-9dab-c5eb8d871a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd02df2f-b59a-4934-a86c-286164078589', 'volume_name': 'volume-cd02df2f-b59a-4934-a86c-286164078589', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c1a604-c4bc-4e57-a6f9-719700721420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c1a604-c4bc-4e57-a6f9-719700721420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabcceff-deb2-481e-a027-3864f3f96e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Volume cd02df2f-b59a-4934-a86c-286164078589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd02df2f-b59a-4934-a86c-286164078589', 'volume_size': 1} Jul 07 15:18:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:32 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608" returned: 0 in 5.846s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acd39a7-0b1e-41a5-8154-42c6bac03bd2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:32 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 Jul 07 15:18:32 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-ccef9d93-aa96-410c-8896-57207423b62f req-0c884544-220c-4e1d-8b1c-d1d9c7a45dc1 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Terminate volume connection completed successfully. Jul 07 15:18:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-ccef9d93-aa96-410c-8896-57207423b62f req-0c884544-220c-4e1d-8b1c-d1d9c7a45dc1 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Deleting attachment 82035d9d-0108-4648-b73d-142d13528d00. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:18:33 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09" returned: 0 in 0.943s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:33 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:18:33 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Converted 1024.00 MB image at 175.14 MB/s Jul 07 15:18:33 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 is being set with open permissions: ugo+rw Jul 07 15:18:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:33 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 Jul 07 15:18:33 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:34 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-3ff646ed-e062-4264-86ba-b99fa775f608" released by "_copy_volume_from_snapshot" :: held 9.617s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-eb1faf28-9787-40b1-bba9-94ca836ada1d-3ff646ed-e062-4264-86ba-b99fa775f608" released by "_create_volume_from_snapshot" :: held 9.666s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.688s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.637s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-651982285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe3885c-050e-4937-8ceb-5af03355c0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2e6555c2ee40d7b403d68c7bd0bf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:23Z,use_quota=True,user_id='927d1f0bb7884a1c968d937df5d076f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Creating volume dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:34 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:34 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 1073741824 Jul 07 15:18:34 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d89a5d-e5fb-464a-81bb-94f1fea3545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff646ed-e062-4264-86ba-b99fa775f608', 'volume_size': 1, 'snapshot_id': 'eb1faf28-9787-40b1-bba9-94ca836ada1d'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb7919f-0af3-43d1-8bab-de9e56f00bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:34 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Volume volume-3ff646ed-e062-4264-86ba-b99fa775f608 (3ff646ed-e062-4264-86ba-b99fa775f608): created successfully Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb7919f-0af3-43d1-8bab-de9e56f00bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Flow 'volume_create_manager' (d553a986-3e78-4c27-8bc6-51544348635e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-62f80bef-e912-43a2-afb7-1dc9ede1c259 tempest-VolumesDeleteCascade-799668294 None] Created volume successfully. Jul 07 15:18:35 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 1073741824" returned: 0 in 0.956s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:35 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:35 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-6dec4b0f-72d2-4940-b0ac-feec6108bd09-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-6dec4b0f-72d2-4940-b0ac-feec6108bd09-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Acquiring lock "cinder-0cf26300-92ab-484d-80d7-e53cd3324e33-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Performing cascade delete. {{(pid=87257) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "cinder-0cf26300-92ab-484d-80d7-e53cd3324e33-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-eb1faf28-9787-40b1-bba9-94ca836ada1d-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-eb1faf28-9787-40b1-bba9-94ca836ada1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-6dec4b0f-72d2-4940-b0ac-feec6108bd09" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Acquiring lock "cinder-quobyte-0cf26300-92ab-484d-80d7-e53cd3324e33" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-6dec4b0f-72d2-4940-b0ac-feec6108bd09" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-eb1faf28-9787-40b1-bba9-94ca836ada1d" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "cinder-quobyte-0cf26300-92ab-484d-80d7-e53cd3324e33" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-eb1faf28-9787-40b1-bba9-94ca836ada1d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Deleting offline snapshot eb1faf28-9787-40b1-bba9-94ca836ada1d of volume 6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] snapshot_file for this snap is: volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a668d70a-6b40-42cf-8ebc-ca1902abe367]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897de37-438f-4b38-8f04-0efa35ff334b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:36 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 Jul 07 15:18:36 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:36 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d Jul 07 15:18:36 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:36 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 0 in 0.868s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.838s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1436691059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd02df2f-b59a-4934-a86c-286164078589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc817e39ed24dd8b8e2dd44cc728c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:27Z,use_quota=True,user_id='c266fbb79aae43be91c7dda7f1e2abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Creating volume cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:36 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Attempting download of 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume dbe3885c-050e-4937-8ceb-5af03355c0c4. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:18:36 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 1073741824 Jul 07 15:18:36 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a8bc4-4204-4939-a08b-1de2ea0741fa]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_wwliatq1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:36 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_wwliatq1 Jul 07 15:18:36 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:37 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d" returned: 0 in 1.109s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d954478-f6e6-4b21-8e1e-c8b1c7a6b51f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:37 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 Jul 07 15:18:37 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:37 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33" returned: 0 in 1.381s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:37 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33 Jul 07 15:18:37 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:37 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_wwliatq1" returned: 0 in 1.092s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_wwliatq1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:37 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_wwliatq1 Jul 07 15:18:37 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:37 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 1073741824" returned: 0 in 1.377s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:37 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:18:37 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:38 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09" returned: 0 in 1.033s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:38 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cf26300-92ab-484d-80d7-e53cd3324e33" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "cinder-quobyte-0cf26300-92ab-484d-80d7-e53cd3324e33" released by "delete_volume" :: held 2.273s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:38 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d Jul 07 15:18:38 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Created reservations ['b2009512-2398-4244-a235-8e899598d873', '07e07255-c62b-4f8c-a290-88d6f0ac0b2a', '809f9243-26f8-48db-8242-8431cdce381f', '32092dc1-a9ad-47f9-b337-b295dc01e6c5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:38 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_wwliatq1" returned: 1 in 0.913s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_wwliatq1' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba3597-208c-4ed4-b8be-45c2d654648e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:38 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:38 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:38 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 0.874s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabcceff-deb2-481e-a027-3864f3f96e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd02df2f-b59a-4934-a86c-286164078589', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:38 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD Jul 07 15:18:38 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d54fd73-2274-406d-ab20-c52879a6fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:38 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Volume volume-cd02df2f-b59a-4934-a86c-286164078589 (cd02df2f-b59a-4934-a86c-286164078589): created successfully Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d54fd73-2274-406d-ab20-c52879a6fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Flow 'volume_create_manager' (d1296da5-d3b2-4ac8-ae92-0d75ef9079f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8e9e7391-023a-4f02-b1e5-86707e886cfb tempest-TestStampPattern-1153125313 None] Created volume successfully. Jul 07 15:18:38 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d" returned: 0 in 0.843s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:38 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d Jul 07 15:18:38 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:39 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.739s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Deleted volume successfully. Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c1c4914c-79a0-418a-86b2-1829f62843e4 tempest-TestServerVolumeAttachScenarioOldVersion-1268882569 None] Lock "cinder-0cf26300-92ab-484d-80d7-e53cd3324e33-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:39 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD" returned: 0 in 0.984s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] 7c780384-ba04-4889-abec-1e35c2057312 was qcow2, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:39 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:39 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:39 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09.eb1faf28-9787-40b1-bba9-94ca836ada1d" returned: 0 in 0.804s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-eb1faf28-9787-40b1-bba9-94ca836ada1d" released by "_delete_snapshot" :: held 3.901s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-6dec4b0f-72d2-4940-b0ac-feec6108bd09" released by "delete_snapshot" :: held 3.935s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Created reservations ['0a2bdce5-d636-4154-a0a3-7ae231dc44c8', '8cc53930-7f11-4b71-9d16-97776e7c01e7', '4e3c333b-53f7-4f2b-857c-bb31700355a6', 'b7d6110f-3108-45b6-9970-bbc13cb3117e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Delete snapshot completed successfully. Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-eb1faf28-9787-40b1-bba9-94ca836ada1d-delete_snapshot" released by "delete_snapshot" :: held 4.144s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Snapshots deleted, issuing volume delete {{(pid=87257) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-6dec4b0f-72d2-4940-b0ac-feec6108bd09" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-6dec4b0f-72d2-4940-b0ac-feec6108bd09" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[05300d31-cad0-47bf-a865-81de39c72745]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:40 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 Jul 07 15:18:40 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:41 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09" returned: 0 in 1.538s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:41 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09 Jul 07 15:18:41 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:42 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 0 in 2.902s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:42 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_9fjnewa2devstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:18:42 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Converted 112.00 MB image at 38.57 MB/s Jul 07 15:18:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:42 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 1G Jul 07 15:18:42 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:42 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6dec4b0f-72d2-4940-b0ac-feec6108bd09" returned: 0 in 1.190s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-6dec4b0f-72d2-4940-b0ac-feec6108bd09" released by "delete_volume" :: held 2.886s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:42 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Created reservations ['c00e2648-3ea2-4fab-92ab-f678e77509d4', '803903ce-250c-4eb1-8699-70ef05fd78f4', 'df96648e-5099-415f-b7d6-cae6c8dbf7e0', '8767e0c1-61f2-44c3-98db-cd30196dbc99'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:43 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:43 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:43 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 1G" returned: 0 in 1.355s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee63418f-4626-48d1-b2ea-a911b28d74a8]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:44 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:44 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-3ff646ed-e062-4264-86ba-b99fa775f608-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-3ff646ed-e062-4264-86ba-b99fa775f608-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "cinder-quobyte-3ff646ed-e062-4264-86ba-b99fa775f608" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-3ff646ed-e062-4264-86ba-b99fa775f608" acquired by "delete_volume" :: waited 0.068s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ca6b88-6684-4619-974b-d3f55f738e47]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:44 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.477s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Deleted volume successfully. Jul 07 15:18:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fda95bb5-af70-4c71-8c09-ad3c1cab492b tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-6dec4b0f-72d2-4940-b0ac-feec6108bd09-delete_volume" released by "delete_volume" :: held 9.059s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:44 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 Jul 07 15:18:44 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:45 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 0 in 1.772s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:45 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:45 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:45 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608" returned: 0 in 1.235s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:45 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608 Jul 07 15:18:45 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:46 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 1 in 1.100s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Downloaded image 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume dbe3885c-050e-4937-8ceb-5af03355c0c4 successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 for user 927d1f0bb7884a1c968d937df5d076f7 is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Marking volume dbe3885c-050e-4937-8ceb-5af03355c0c4 as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Copying metadata from image 7c780384-ba04-4889-abec-1e35c2057312 to dbe3885c-050e-4937-8ceb-5af03355c0c4. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Creating volume glance metadata for volume dbe3885c-050e-4937-8ceb-5af03355c0c4 backed by image 7c780384-ba04-4889-abec-1e35c2057312 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:18:46 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ff646ed-e062-4264-86ba-b99fa775f608" returned: 0 in 0.844s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-quobyte-3ff646ed-e062-4264-86ba-b99fa775f608" released by "delete_volume" :: held 2.165s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67aeeaf8-a6bc-4e79-be34-4b348b8d2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe3885c-050e-4937-8ceb-5af03355c0c4', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fd8e8c-e9fb-4033-99d0-25e930eaa000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Volume volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 (dbe3885c-050e-4937-8ceb-5af03355c0c4): created successfully Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fd8e8c-e9fb-4033-99d0-25e930eaa000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Flow 'volume_create_manager' (98ac14d1-7f07-43e4-adf2-0473c8636956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ac7e00c7-ca23-49a3-83f1-977bca72af9d tempest-VolumesExtendTest-1636738989 None] Created volume successfully. Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Created reservations ['86af2430-d68d-4916-a654-098118be45ea', '94f5a739-76bd-49a9-bf20-ac7a8ab2c47f', '4710124b-2ffa-49e1-9594-bd1a59840b76', 'a4b27a52-42f8-404c-90de-6556c990bc85'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:46 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:46 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[470364a6-3a91-4765-a1ee-b0757f306909]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:47 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:47 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:47 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.914s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:47 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Deleted volume successfully. Jul 07 15:18:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c988ebbf-42f3-45b6-ba37-b27b4cf1df15 tempest-VolumesDeleteCascade-799668294 None] Lock "cinder-3ff646ed-e062-4264-86ba-b99fa775f608-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:48 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 0 in 1.225s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:48 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:48 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:49 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 1 in 1.108s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:18:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 2G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 2G" returned: 0 in 0.093s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.490s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-69a3bf72-963d-4d7b-bec2-fe438565ece8 tempest-VolumesExtendTest-1636738989 None] Extend volume completed successfully. Jul 07 15:18:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Acquiring lock "cinder-dbe3885c-050e-4937-8ceb-5af03355c0c4-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Lock "cinder-dbe3885c-050e-4937-8ceb-5af03355c0c4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Acquiring lock "cinder-quobyte-dbe3885c-050e-4937-8ceb-5af03355c0c4" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:18:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-dbe3885c-050e-4937-8ceb-5af03355c0c4" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:18:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0122e65d-3f8b-4ba7-addb-82b13c4b1df7]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:51 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:51 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:52 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 0 in 1.031s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:52 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:52 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:53 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 1 in 1.143s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:18:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:53 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4 Jul 07 15:18:53 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:54 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dbe3885c-050e-4937-8ceb-5af03355c0c4" returned: 0 in 0.852s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-dbe3885c-050e-4937-8ceb-5af03355c0c4" released by "delete_volume" :: held 3.117s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Created reservations ['c223f551-dcf0-4e40-ac1c-62775336140c', '98145c9a-a620-4ccf-bdc7-a97b99b5af59', 'dc14d317-87ac-4c90-a7a1-bd8b2d779b6b', 'bbf3d6fc-5ebf-4abd-a626-886273099d6e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:54 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:18:54 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:55 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.811s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:55 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:18:55 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Deleted volume successfully. Jul 07 15:18:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dfb37b6-6c80-44e9-ac6e-4e22a461eeae tempest-VolumesExtendTest-1636738989 None] Lock "cinder-dbe3885c-050e-4937-8ceb-5af03355c0c4-delete_volume" released by "delete_volume" :: held 4.405s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Flow 'volume_create_manager' (591f9616-8ba0-4332-869b-dadbc2e50db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144415d6-c59e-4cd8-aeb3-6d111f2c2fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144415d6-c59e-4cd8-aeb3-6d111f2c2fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-878971799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2213dca9-9e97-40fb-a81a-162d4e95d90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2e6555c2ee40d7b403d68c7bd0bf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:56Z,use_quota=True,user_id='927d1f0bb7884a1c968d937df5d076f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d51643-1dd4-4c46-a473-1f1a9abc081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d51643-1dd4-4c46-a473-1f1a9abc081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430353a1-311c-44ce-83ab-6565e5fa1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430353a1-311c-44ce-83ab-6565e5fa1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2213dca9-9e97-40fb-a81a-162d4e95d90b', 'volume_name': 'volume-2213dca9-9e97-40fb-a81a-162d4e95d90b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7faf30e5-f9ee-423f-87ec-aa68ccc86f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7faf30e5-f9ee-423f-87ec-aa68ccc86f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9017e50a-7804-4142-8525-a15e32b92f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:56 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Volume 2213dca9-9e97-40fb-a81a-162d4e95d90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2213dca9-9e97-40fb-a81a-162d4e95d90b', 'volume_size': 1} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-878971799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2213dca9-9e97-40fb-a81a-162d4e95d90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2e6555c2ee40d7b403d68c7bd0bf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:18:56Z,use_quota=True,user_id='927d1f0bb7884a1c968d937df5d076f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Creating volume 2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:18:56 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:18:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:56 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b 1073741824 Jul 07 15:18:56 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:57 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b 1073741824" returned: 0 in 0.941s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:57 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b Jul 07 15:18:57 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:58 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9017e50a-7804-4142-8525-a15e32b92f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2213dca9-9e97-40fb-a81a-162d4e95d90b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53486370-8875-4abc-bac0-cc4b6a7882bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:18:58 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Volume volume-2213dca9-9e97-40fb-a81a-162d4e95d90b (2213dca9-9e97-40fb-a81a-162d4e95d90b): created successfully Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53486370-8875-4abc-bac0-cc4b6a7882bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Flow 'volume_create_manager' (591f9616-8ba0-4332-869b-dadbc2e50db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:18:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8808489d-4fb6-4a7f-a385-fe8e6d1a4826 tempest-VolumesExtendTest-1636738989 None] Created volume successfully. Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Creating offline snapshot 4b067db3-db08-4c4c-b63b-d226c0394fdf of volume 2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb153dc-69f5-4885-af1b-9c5e3c0ebf42]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:18:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:58 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b Jul 07 15:18:58 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:18:59 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 07 15:18:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b" returned: 0 in 0.826s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:18:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:18:59 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf 1G Jul 07 15:18:59 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:00 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:00 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:00 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf 1G" returned: 0 in 0.967s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2213dca9-9e97-40fb-a81a-162d4e95d90b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:00 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2213dca9-9e97-40fb-a81a-162d4e95d90b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf Jul 07 15:19:00 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:00 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.790s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 28 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:19:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:19:01 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2213dca9-9e97-40fb-a81a-162d4e95d90b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf" returned: 0 in 0.935s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:01 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf is being set with open permissions: ugo+rw Jul 07 15:19:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:01 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf Jul 07 15:19:01 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:02 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf" returned: 0 in 0.834s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:02 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.info Jul 07 15:19:02 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Flow 'volume_create_manager' (32e37b98-23d1-48e0-807e-a3ebd306b70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dacb6e-e0ef-41b8-a5e7-77beed1b0d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dacb6e-e0ef-41b8-a5e7-77beed1b0d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1525293307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08a914e-5f0e-42c5-9579-e8441498272d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e17d875494d19958f3721409e0e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:02Z,use_quota=True,user_id='c5207f5e0aa34c3d8799c0a5ec677dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4803a7c2-d981-4b68-8c66-636a425aed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4803a7c2-d981-4b68-8c66-636a425aed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8517043-26b0-4af1-bc85-81d004f58564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8517043-26b0-4af1-bc85-81d004f58564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08a914e-5f0e-42c5-9579-e8441498272d', 'volume_name': 'volume-b08a914e-5f0e-42c5-9579-e8441498272d', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c719426d-efde-4610-a53a-ee96568b2bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c719426d-efde-4610-a53a-ee96568b2bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7333b95c-5fa4-45be-86b1-19684d74a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:02 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Volume b08a914e-5f0e-42c5-9579-e8441498272d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08a914e-5f0e-42c5-9579-e8441498272d', 'volume_size': 1} Jul 07 15:19:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:03 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.info" returned: 0 in 0.764s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:03 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.info is being set with open permissions: ugo+rw Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:03 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.info Jul 07 15:19:03 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:03 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.info" returned: 0 in 0.711s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.169s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1525293307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08a914e-5f0e-42c5-9579-e8441498272d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8e17d875494d19958f3721409e0e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:02Z,use_quota=True,user_id='c5207f5e0aa34c3d8799c0a5ec677dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Creating volume b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:03 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:03 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d 1073741824 Jul 07 15:19:03 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-23748744-877d-4597-864b-45ed5b9c94ac tempest-VolumesExtendTest-1636738989 None] Create snapshot completed successfully Jul 07 15:19:04 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d 1073741824" returned: 0 in 1.052s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:04 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:19:04 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:05 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 0.747s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.530s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7333b95c-5fa4-45be-86b1-19684d74a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08a914e-5f0e-42c5-9579-e8441498272d', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c07ab7c-2b42-4a92-9470-70da8c901520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cc19c4-f5c4-42ff-8477-69a72f848870]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:05 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Volume volume-b08a914e-5f0e-42c5-9579-e8441498272d (b08a914e-5f0e-42c5-9579-e8441498272d): created successfully Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c07ab7c-2b42-4a92-9470-70da8c901520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:05 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Flow 'volume_create_manager' (32e37b98-23d1-48e0-807e-a3ebd306b70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-10f9bdfe-1aa4-4d7f-9f66-2ee7828be399 tempest-VolumesActionsTest-1688544316 None] Created volume successfully. Jul 07 15:19:05 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b Jul 07 15:19:05 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:06 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b" returned: 0 in 0.807s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf 2G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf 2G" returned: 0 in 0.168s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.019s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4a600b7a-4659-4d04-bb5c-8ecf211b1487 tempest-VolumesExtendTest-1636738989 None] Extend volume completed successfully. Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "cinder-4b067db3-db08-4c4c-b63b-d226c0394fdf-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-4b067db3-db08-4c4c-b63b-d226c0394fdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "cinder-quobyte-2213dca9-9e97-40fb-a81a-162d4e95d90b" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-2213dca9-9e97-40fb-a81a-162d4e95d90b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "cinder-quobyte-4b067db3-db08-4c4c-b63b-d226c0394fdf" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-4b067db3-db08-4c4c-b63b-d226c0394fdf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Deleting offline snapshot 4b067db3-db08-4c4c-b63b-d226c0394fdf of volume 2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] snapshot_file for this snap is: volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f476d57-5920-4407-ae0d-3f255d16cdf5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:07 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf Jul 07 15:19:07 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:08 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2213dca9-9e97-40fb-a81a-162d4e95d90b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[770ad54f-0e12-4ff5-aa9e-8697ee0003b7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:08 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b Jul 07 15:19:08 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (6548aad7-e0eb-4cc1-9c99-052541ffbc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816c232e-d6d8-410f-8800-d4c9a40def66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816c232e-d6d8-410f-8800-d4c9a40def66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136620365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a51325-0cc2-468c-9e67-5d1c4f816b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:09Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1796db4d-82ad-4fc1-84e0-0855a9fe633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1796db4d-82ad-4fc1-84e0-0855a9fe633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3656c6c7-d63e-4f2b-bd0c-bc80c2429b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3656c6c7-d63e-4f2b-bd0c-bc80c2429b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a51325-0cc2-468c-9e67-5d1c4f816b29', 'volume_name': 'volume-19a51325-0cc2-468c-9e67-5d1c4f816b29', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345b6a65-d7f2-45cd-b1db-89f132deda96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345b6a65-d7f2-45cd-b1db-89f132deda96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e30908a-ca1a-4073-b3f7-cf310e7b3441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:08 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Volume 19a51325-0cc2-468c-9e67-5d1c4f816b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a51325-0cc2-468c-9e67-5d1c4f816b29', 'volume_size': 1} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136620365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a51325-0cc2-468c-9e67-5d1c4f816b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:09Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Creating volume 19a51325-0cc2-468c-9e67-5d1c4f816b29 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:08 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:08 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 1073741824 Jul 07 15:19:08 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (b560bf1d-f9ef-49e9-9bbf-1166260acbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07afd350-1d0b-4952-81cf-1d3f84e13f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07afd350-1d0b-4952-81cf-1d3f84e13f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859809714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19aa38a-8d10-4421-8fbe-ab1a85242a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:09Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b895b22-e4fe-479c-9335-34693aaaa851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b895b22-e4fe-479c-9335-34693aaaa851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63315a35-9b8c-4e92-aa0f-4bacbfa4b36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63315a35-9b8c-4e92-aa0f-4bacbfa4b36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19aa38a-8d10-4421-8fbe-ab1a85242a48', 'volume_name': 'volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0767267d-a5eb-4dec-a0f6-39994e405efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0767267d-a5eb-4dec-a0f6-39994e405efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451714d3-d497-4d63-a6e8-835669871fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Volume c19aa38a-8d10-4421-8fbe-ab1a85242a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48', 'volume_size': 1} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:09 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b" returned: 0 in 1.050s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:09 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf Jul 07 15:19:09 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (c8cbcbb9-74c4-4158-8259-1384da0fa3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c28f20-bd2d-4520-b420-230f349cb5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c28f20-bd2d-4520-b420-230f349cb5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624291653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b2f55c-089f-4c95-8953-c42e82eeb085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:10Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca18d6c-248d-4469-b668-ad696995ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca18d6c-248d-4469-b668-ad696995ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd8598a-5960-486e-bb79-ed3b36102a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd8598a-5960-486e-bb79-ed3b36102a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b2f55c-089f-4c95-8953-c42e82eeb085', 'volume_name': 'volume-d5b2f55c-089f-4c95-8953-c42e82eeb085', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91199987-f4bc-40d7-8f09-bad3443f23b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91199987-f4bc-40d7-8f09-bad3443f23b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b9f390-2993-4190-b987-8bb8a6eb5059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:09 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Volume d5b2f55c-089f-4c95-8953-c42e82eeb085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b2f55c-089f-4c95-8953-c42e82eeb085', 'volume_size': 1} Jul 07 15:19:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:10 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (c5631c16-bb19-4e31-b8f0-7a05dec41a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e690b43-bac7-4f4c-b28b-271d029a892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 1073741824" returned: 0 in 1.407s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e690b43-bac7-4f4c-b28b-271d029a892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748318726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034c903d-e11a-4d11-a097-869792912db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:10Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70615c68-8b55-4052-ab4f-109dc4abf1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70615c68-8b55-4052-ab4f-109dc4abf1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd40818-f86e-4936-bdce-41d3c6cdaf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd40818-f86e-4936-bdce-41d3c6cdaf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034c903d-e11a-4d11-a097-869792912db3', 'volume_name': 'volume-034c903d-e11a-4d11-a097-869792912db3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280389b2-74b1-4c6f-8a75-6bc5dd14bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280389b2-74b1-4c6f-8a75-6bc5dd14bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1af4a0-589a-4c9a-9190-67d4f2972614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Volume 034c903d-e11a-4d11-a097-869792912db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034c903d-e11a-4d11-a097-869792912db3', 'volume_size': 1} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:10 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 Jul 07 15:19:10 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf" returned: 0 in 1.115s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:10 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:10 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf Jul 07 15:19:10 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (1d9db308-b4b6-47ba-b583-e1099798a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3601879e-d73c-4f7b-9634-c019268121a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3601879e-d73c-4f7b-9634-c019268121a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566320778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df6153a-85f5-4f6e-ba07-1efe9d10dc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:11Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e38a40-89d6-47c6-a0f7-0f8b0c9ef053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e38a40-89d6-47c6-a0f7-0f8b0c9ef053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffe08d7-076c-4fa8-8e7d-7dfc7eb4948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffe08d7-076c-4fa8-8e7d-7dfc7eb4948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df6153a-85f5-4f6e-ba07-1efe9d10dc4c', 'volume_name': 'volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606eb804-6675-4c91-b169-86de69251b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606eb804-6675-4c91-b169-86de69251b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1f043d-5243-46d8-af6f-dd09a8ba7e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:10 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Volume 7df6153a-85f5-4f6e-ba07-1efe9d10dc4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c', 'volume_size': 1} Jul 07 15:19:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:11 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29" returned: 0 in 0.834s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859809714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19aa38a-8d10-4421-8fbe-ab1a85242a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:09Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Creating volume c19aa38a-8d10-4421-8fbe-ab1a85242a48 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:11 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e30908a-ca1a-4073-b3f7-cf310e7b3441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a51325-0cc2-468c-9e67-5d1c4f816b29', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:11 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 1073741824 Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787fa725-002c-4c47-8ffe-d54119e0d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:11 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:11 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Volume volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 (19a51325-0cc2-468c-9e67-5d1c4f816b29): created successfully Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787fa725-002c-4c47-8ffe-d54119e0d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (6548aad7-e0eb-4cc1-9c99-052541ffbc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:11 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0648f6bb-9ca1-4ef9-ae40-72ae3de4c9b7 tempest-CreateVolumesFromImageTest-17305972 None] Created volume successfully. Jul 07 15:19:11 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b.4b067db3-db08-4c4c-b63b-d226c0394fdf" returned: 0 in 0.745s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-4b067db3-db08-4c4c-b63b-d226c0394fdf" released by "_delete_snapshot" :: held 3.839s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-2213dca9-9e97-40fb-a81a-162d4e95d90b" released by "delete_snapshot" :: held 3.866s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Created reservations ['84973f68-42ef-47fc-bc2b-41bc8ac58613', 'c40bd2a9-38d4-4ac0-bca7-84f85f3fba67', '81e674a1-da68-4bf1-b35a-98e25e883a37', '7a2186d8-af91-4e01-9308-f65b67a0647b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:11 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Delete snapshot completed successfully. Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3563314a-2601-40fb-b90f-89a8b7f11107 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-4b067db3-db08-4c4c-b63b-d226c0394fdf-delete_snapshot" released by "delete_snapshot" :: held 4.014s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "cinder-2213dca9-9e97-40fb-a81a-162d4e95d90b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-2213dca9-9e97-40fb-a81a-162d4e95d90b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "cinder-quobyte-2213dca9-9e97-40fb-a81a-162d4e95d90b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-2213dca9-9e97-40fb-a81a-162d4e95d90b" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a8f17-711a-480d-9bd6-bec51d878cb6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:12 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b Jul 07 15:19:12 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:12 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 1073741824" returned: 0 in 0.958s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:12 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 Jul 07 15:19:12 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:12 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b" returned: 0 in 0.871s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:12 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b Jul 07 15:19:12 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-b03cc8c2-1eda-4042-8569-07c2b21af178 req-4ad2dbc8-31ba-401b-b1f0-8f0b1961c0e7 tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:12 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48" returned: 0 in 0.824s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.056s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624291653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b2f55c-089f-4c95-8953-c42e82eeb085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:10Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Creating volume d5b2f55c-089f-4c95-8953-c42e82eeb085 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:13 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451714d3-d497-4d63-a6e8-835669871fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:13 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 1073741824 Jul 07 15:19:13 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23e06dd-693b-417b-a140-52136e92fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:13 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Volume volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 (c19aa38a-8d10-4421-8fbe-ab1a85242a48): created successfully Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23e06dd-693b-417b-a140-52136e92fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (b560bf1d-f9ef-49e9-9bbf-1166260acbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-65489526-70a6-4e97-b4c5-60095f697a69 tempest-CreateVolumesFromImageTest-17305972 None] Created volume successfully. Jul 07 15:19:13 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2213dca9-9e97-40fb-a81a-162d4e95d90b" returned: 0 in 0.880s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-quobyte-2213dca9-9e97-40fb-a81a-162d4e95d90b" released by "delete_volume" :: held 1.819s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Created reservations ['4d1adac4-1017-4de2-907c-ee167505ab9c', '0b70eb66-3926-4c04-8e3f-7a846b46d673', '91aa51cd-4677-48bb-8202-ce9428952a0f', 'd8fb48b7-71e6-422e-83de-335d41ceccd7'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:13 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:13 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:14 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 1073741824" returned: 0 in 1.039s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:14 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 Jul 07 15:19:14 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:14 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.856s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:14 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:14 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Deleted volume successfully. Jul 07 15:19:14 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a1450533-23f8-4d5b-bb26-427469367454 tempest-VolumesExtendTest-1636738989 None] Lock "cinder-2213dca9-9e97-40fb-a81a-162d4e95d90b-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:15 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085" returned: 0 in 0.919s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.782s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748318726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034c903d-e11a-4d11-a097-869792912db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:10Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Creating volume 034c903d-e11a-4d11-a097-869792912db3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:15 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:15 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 1073741824 Jul 07 15:19:15 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b9f390-2993-4190-b987-8bb8a6eb5059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b2f55c-089f-4c95-8953-c42e82eeb085', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f23d23-7875-492d-99e7-7bd82f76476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:15 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Volume volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 (d5b2f55c-089f-4c95-8953-c42e82eeb085): created successfully Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f23d23-7875-492d-99e7-7bd82f76476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (c8cbcbb9-74c4-4158-8259-1384da0fa3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fbe5f503-f48a-443a-a358-d8f1e549b955 tempest-CreateVolumesFromImageTest-17305972 None] Created volume successfully. Jul 07 15:19:15 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 1073741824" returned: 0 in 0.923s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:16 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 Jul 07 15:19:16 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:16 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3" returned: 0 in 0.676s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.954s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566320778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df6153a-85f5-4f6e-ba07-1efe9d10dc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77210882480a4f5694a6ff045691faa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:11Z,use_quota=True,user_id='c1476053e4e34e7fb81d74cdd6ca34a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Creating volume 7df6153a-85f5-4f6e-ba07-1efe9d10dc4c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:16 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:16 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c 1073741824 Jul 07 15:19:16 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1af4a0-589a-4c9a-9190-67d4f2972614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034c903d-e11a-4d11-a097-869792912db3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a238c613-a511-4c52-8c81-0cadecaf96d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:16 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Volume volume-034c903d-e11a-4d11-a097-869792912db3 (034c903d-e11a-4d11-a097-869792912db3): created successfully Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a238c613-a511-4c52-8c81-0cadecaf96d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (c5631c16-bb19-4e31-b8f0-7a05dec41a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:16 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5f465034-af4b-4669-92fc-be27760c2492 tempest-CreateVolumesFromImageTest-17305972 None] Created volume successfully. Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Flow 'volume_create_manager' (4d1c6d39-6cff-47f3-90ed-09e75f69ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6189e2-46cd-45ba-b60f-847e1144cb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6189e2-46cd-45ba-b60f-847e1144cb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-808411344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca0f56e-28fe-4202-927a-aebb2c36594e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c17a830d1cb34d27926abb18c8259eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:18Z,use_quota=True,user_id='41284ebab8864b10be426c0b86619967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4858b44-c517-4793-ad42-6c9702b413fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4858b44-c517-4793-ad42-6c9702b413fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267c624a-c174-4b40-99ed-b4419d6c4fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (267c624a-c174-4b40-99ed-b4419d6c4fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca0f56e-28fe-4202-927a-aebb2c36594e', 'volume_name': 'volume-2ca0f56e-28fe-4202-927a-aebb2c36594e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a9163a-168e-4b98-b2a1-21448874eec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a9163a-168e-4b98-b2a1-21448874eec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17b4a76-c777-4757-a515-018cdb02aaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:17 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Volume 2ca0f56e-28fe-4202-927a-aebb2c36594e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca0f56e-28fe-4202-927a-aebb2c36594e', 'volume_size': 1} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:17 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c 1073741824" returned: 0 in 0.949s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:17 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c Jul 07 15:19:17 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:18 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c" returned: 0 in 0.827s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-b03cc8c2-1eda-4042-8569-07c2b21af178 req-4ad2dbc8-31ba-401b-b1f0-8f0b1961c0e7 tempest-TestStampPattern-1153125313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.646s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1f043d-5243-46d8-af6f-dd09a8ba7e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16a9af5-1053-479e-bc8b-54bc0bd85694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c126b085-550b-48c1-910b-3207cc2e3e4f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-b03cc8c2-1eda-4042-8569-07c2b21af178 req-4ad2dbc8-31ba-401b-b1f0-8f0b1961c0e7 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:18 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Volume volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c (7df6153a-85f5-4f6e-ba07-1efe9d10dc4c): created successfully Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16a9af5-1053-479e-bc8b-54bc0bd85694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Flow 'volume_create_manager' (1d9db308-b4b6-47ba-b583-e1099798a28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-42533dd7-ab0e-4a48-a683-a9ae5902372a tempest-CreateVolumesFromImageTest-17305972 None] Created volume successfully. Jul 07 15:19:18 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:19:18 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:19 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-b03cc8c2-1eda-4042-8569-07c2b21af178 req-4ad2dbc8-31ba-401b-b1f0-8f0b1961c0e7 tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 0.786s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-b03cc8c2-1eda-4042-8569-07c2b21af178 req-4ad2dbc8-31ba-401b-b1f0-8f0b1961c0e7 tempest-TestStampPattern-1153125313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.842s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.742s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-808411344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca0f56e-28fe-4202-927a-aebb2c36594e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c17a830d1cb34d27926abb18c8259eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:18Z,use_quota=True,user_id='41284ebab8864b10be426c0b86619967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Creating volume 2ca0f56e-28fe-4202-927a-aebb2c36594e {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:19 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:19 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e 1073741824 Jul 07 15:19:19 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-b03cc8c2-1eda-4042-8569-07c2b21af178 req-4ad2dbc8-31ba-401b-b1f0-8f0b1961c0e7 tempest-TestStampPattern-1153125313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-cd02df2f-b59a-4934-a86c-286164078589', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '753d9448-9382-4052-9738-12b0ddfa1fc3', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:19:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-b03cc8c2-1eda-4042-8569-07c2b21af178 req-4ad2dbc8-31ba-401b-b1f0-8f0b1961c0e7 tempest-TestStampPattern-1153125313 None] attachment_update completed successfully. Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-quobyte-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:20 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb31f12-0cbb-46b9-8d05-f9da4edaebca]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:20 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c Jul 07 15:19:20 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:20 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e 1073741824" returned: 0 in 1.045s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:20 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e Jul 07 15:19:20 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:20 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c" returned: 0 in 0.981s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:21 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c Jul 07 15:19:21 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:21 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e" returned: 0 in 0.811s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17b4a76-c777-4757-a515-018cdb02aaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca0f56e-28fe-4202-927a-aebb2c36594e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35307ad2-7b80-4506-a5a5-2678163a8c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Volume volume-2ca0f56e-28fe-4202-927a-aebb2c36594e (2ca0f56e-28fe-4202-927a-aebb2c36594e): created successfully Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35307ad2-7b80-4506-a5a5-2678163a8c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Flow 'volume_create_manager' (4d1c6d39-6cff-47f3-90ed-09e75f69ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:21 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b8fb22b9-f81c-4558-964b-ec1f205a7a14 tempest-VolumesListTestJSON-1976389235 None] Created volume successfully. Jul 07 15:19:21 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c" returned: 0 in 0.809s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c" released by "delete_volume" :: held 1.902s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:21 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Created reservations ['590cbd9c-93bf-4ad8-bc7d-3d5ee3c9191a', 'c466d0c5-0b83-4fc0-82a7-904d388a41bd', '1ac48998-d4f8-43e6-ac01-f3c1ffdad814', '7dcf3dc6-67c4-47e2-ac91-66c38bed3d22'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-034c903d-e11a-4d11-a097-869792912db3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:22 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:22 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-034c903d-e11a-4d11-a097-869792912db3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-quobyte-034c903d-e11a-4d11-a097-869792912db3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-034c903d-e11a-4d11-a097-869792912db3" acquired by "delete_volume" :: waited 0.038s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48f5bb5-37b5-4638-b86a-5374dfa14b0f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:22 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 Jul 07 15:19:22 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:23 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Flow 'volume_create_manager' (8e6c622e-625d-4c86-96fe-7d34bed3f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb717e86-06e5-49f9-9d58-f7f508665f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.995s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb717e86-06e5-49f9-9d58-f7f508665f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-717959317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a151c27d-d0aa-40b7-98c1-abdbe15e3c4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c17a830d1cb34d27926abb18c8259eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:23Z,use_quota=True,user_id='41284ebab8864b10be426c0b86619967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dad2b9-2a0a-452b-8b00-449c9b633ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dad2b9-2a0a-452b-8b00-449c9b633ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7713540-6fba-4076-bd72-7af5d4f418b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7713540-6fba-4076-bd72-7af5d4f418b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a151c27d-d0aa-40b7-98c1-abdbe15e3c4f', 'volume_name': 'volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5019965d-9146-4e57-ac66-1ae3ab35ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5019965d-9146-4e57-ac66-1ae3ab35ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfe2141-f508-4295-aeec-f1967d2b451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Volume a151c27d-d0aa-40b7-98c1-abdbe15e3c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f', 'volume_size': 1} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-717959317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a151c27d-d0aa-40b7-98c1-abdbe15e3c4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c17a830d1cb34d27926abb18c8259eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:23Z,use_quota=True,user_id='41284ebab8864b10be426c0b86619967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Creating volume a151c27d-d0aa-40b7-98c1-abdbe15e3c4f {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:23 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Deleted volume successfully. Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7d88915-48db-4970-892a-1248aea4d0bd tempest-VolumesActionsTest-1688544316 None] Acquiring lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d" by "attach_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:23 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f 1073741824 Jul 07 15:19:23 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7d88915-48db-4970-892a-1248aea4d0bd tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d" acquired by "attach_volume" :: waited 0.039s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f1b19242-a938-4794-947b-9ff0213be95d tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-7df6153a-85f5-4f6e-ba07-1efe9d10dc4c-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a7d88915-48db-4970-892a-1248aea4d0bd tempest-VolumesActionsTest-1688544316 None] Attaching volume b08a914e-5f0e-42c5-9579-e8441498272d to instance 39843cd7-cebe-4d22-98b7-fbcff6526629 at mountpoint /dev/vdb on host None. Jul 07 15:19:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a7d88915-48db-4970-892a-1248aea4d0bd tempest-VolumesActionsTest-1688544316 None] Attach volume completed successfully. Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7d88915-48db-4970-892a-1248aea4d0bd tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d" released by "attach_volume" :: held 0.209s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:23 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3" returned: 0 in 1.340s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:23 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3 Jul 07 15:19:23 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-66b119c3-7da1-47c0-bea4-50fbb490ff1c tempest-VolumesActionsTest-1688544316 None] Acquiring lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-detach_volume" by "detach_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-66b119c3-7da1-47c0-bea4-50fbb490ff1c tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-66b119c3-7da1-47c0-bea4-50fbb490ff1c tempest-VolumesActionsTest-1688544316 None] Detaching volume b08a914e-5f0e-42c5-9579-e8441498272d from instance 39843cd7-cebe-4d22-98b7-fbcff6526629. Jul 07 15:19:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-66b119c3-7da1-47c0-bea4-50fbb490ff1c tempest-VolumesActionsTest-1688544316 None] Detach volume completed successfully. Jul 07 15:19:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-66b119c3-7da1-47c0-bea4-50fbb490ff1c tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:24 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f 1073741824" returned: 0 in 1.078s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:24 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f Jul 07 15:19:24 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:24 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-034c903d-e11a-4d11-a097-869792912db3" returned: 0 in 0.821s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-034c903d-e11a-4d11-a097-869792912db3" released by "delete_volume" :: held 2.255s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Created reservations ['e4887708-1ff0-4146-8b13-ec4888d562cb', 'b5c1e3d4-a6ee-49bf-a6f2-10d064aa5d21', 'b56a9224-c132-4d77-ac3b-fdfc6ba2ef1a', '3264f5f0-cbcc-4651-86e6-03dbda2d2008'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:24 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:24 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:25 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f" returned: 0 in 0.968s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfe2141-f508-4295-aeec-f1967d2b451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f0069e-9aac-40f2-8957-072009c7787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Volume volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f (a151c27d-d0aa-40b7-98c1-abdbe15e3c4f): created successfully Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f0069e-9aac-40f2-8957-072009c7787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Flow 'volume_create_manager' (8e6c622e-625d-4c86-96fe-7d34bed3f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4979be15-b112-4911-b009-62a0d046d714 tempest-VolumesListTestJSON-1976389235 None] Created volume successfully. Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-d5b2f55c-089f-4c95-8953-c42e82eeb085-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-d5b2f55c-089f-4c95-8953-c42e82eeb085-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-quobyte-d5b2f55c-089f-4c95-8953-c42e82eeb085" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:25 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.850s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Deleted volume successfully. Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-d5b2f55c-089f-4c95-8953-c42e82eeb085" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcbf351-2e5f-4eff-a262-5964e98df452]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5e350f4b-28a4-4547-af01-e437b7363a37 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-034c903d-e11a-4d11-a097-869792912db3-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:25 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 Jul 07 15:19:25 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:26 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085" returned: 0 in 0.796s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:26 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085 Jul 07 15:19:26 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=124,cinder:SELECT=100,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:INSERT=34,cinder:SELECT=90,cinder:UPDATE=105,cinder:DELETE=13 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Flow 'volume_create_manager' (acdd16c2-49d5-4734-8c36-47028c003fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c96a0-1cd4-431b-b454-1c29bd2a448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c96a0-1cd4-431b-b454-1c29bd2a448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-462120340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9141f551-890e-447c-8803-18dca4ef22e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c17a830d1cb34d27926abb18c8259eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:27Z,use_quota=True,user_id='41284ebab8864b10be426c0b86619967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f936b317-275f-406f-a4d7-f01d9cb20b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f936b317-275f-406f-a4d7-f01d9cb20b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0c2eb7-47ce-44cf-8fa7-77ae2e117bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0c2eb7-47ce-44cf-8fa7-77ae2e117bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9141f551-890e-447c-8803-18dca4ef22e3', 'volume_name': 'volume-9141f551-890e-447c-8803-18dca4ef22e3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a4139b-5426-41b4-868a-ccc75b86a744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a4139b-5426-41b4-868a-ccc75b86a744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edf0d30-178e-4d58-b04f-ae964a03044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Volume 9141f551-890e-447c-8803-18dca4ef22e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9141f551-890e-447c-8803-18dca4ef22e3', 'volume_size': 1} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-462120340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9141f551-890e-447c-8803-18dca4ef22e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c17a830d1cb34d27926abb18c8259eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:27Z,use_quota=True,user_id='41284ebab8864b10be426c0b86619967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Creating volume 9141f551-890e-447c-8803-18dca4ef22e3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:27 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:27 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 1073741824 Jul 07 15:19:27 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:27 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d5b2f55c-089f-4c95-8953-c42e82eeb085" returned: 0 in 1.097s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-d5b2f55c-089f-4c95-8953-c42e82eeb085" released by "delete_volume" :: held 1.975s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Created reservations ['a32a4ade-7c32-4e0a-a086-cfd26d406287', 'ad85d05c-5000-4443-be67-1cbee6664b25', '15adbded-2f5c-4912-aac9-b67700958941', '4b2498b5-93cf-4116-8962-bd5ac9a748de'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:27 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:27 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-c19aa38a-8d10-4421-8fbe-ab1a85242a48-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-c19aa38a-8d10-4421-8fbe-ab1a85242a48-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-quobyte-c19aa38a-8d10-4421-8fbe-ab1a85242a48" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-c19aa38a-8d10-4421-8fbe-ab1a85242a48" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f652f4-80f6-426d-ac73-4cce751edb7b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:28 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 Jul 07 15:19:28 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:28 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 1073741824" returned: 0 in 1.393s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:28 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.857s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Deleted volume successfully. Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8fb036fe-44ba-4051-945f-3d4d9d74904c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-d5b2f55c-089f-4c95-8953-c42e82eeb085-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:28 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 Jul 07 15:19:28 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:29 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48" returned: 0 in 0.916s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:29 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48 Jul 07 15:19:29 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:29 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3" returned: 0 in 0.666s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4edf0d30-178e-4d58-b04f-ae964a03044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9141f551-890e-447c-8803-18dca4ef22e3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b2c082-d7d3-48a1-aa48-0b8710781152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Volume volume-9141f551-890e-447c-8803-18dca4ef22e3 (9141f551-890e-447c-8803-18dca4ef22e3): created successfully Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b2c082-d7d3-48a1-aa48-0b8710781152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Flow 'volume_create_manager' (acdd16c2-49d5-4734-8c36-47028c003fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f484a311-e882-4a57-8981-cb0d105c877a tempest-VolumesListTestJSON-1976389235 None] Created volume successfully. Jul 07 15:19:29 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c19aa38a-8d10-4421-8fbe-ab1a85242a48" returned: 0 in 0.670s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-c19aa38a-8d10-4421-8fbe-ab1a85242a48" released by "delete_volume" :: held 1.652s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-da2c863d-4fe6-4969-b196-27abfb098305 req-293f97e8-349b-4331-a90c-7da894d6324d tempest-TestStampPattern-1153125313 None] Terminate volume connection completed successfully. Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-da2c863d-4fe6-4969-b196-27abfb098305 req-293f97e8-349b-4331-a90c-7da894d6324d tempest-TestStampPattern-1153125313 None] Deleting attachment 753d9448-9382-4052-9738-12b0ddfa1fc3. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Created reservations ['6d8dd908-5ccd-420f-bb3c-ac2fab1eb61d', 'b0cdc6dc-13bd-4321-8cf7-f87de540d10a', '4be51289-69e6-4ee1-9b58-f1bcf01c7807', '69c455b8-1de0-4be0-b8a6-a9c981df2790'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:29 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:29 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-19a51325-0cc2-468c-9e67-5d1c4f816b29-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-19a51325-0cc2-468c-9e67-5d1c4f816b29-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "cinder-quobyte-19a51325-0cc2-468c-9e67-5d1c4f816b29" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-19a51325-0cc2-468c-9e67-5d1c4f816b29" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c67147-9f5b-4797-aad5-275619204dd2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:30 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.756s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:30 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 Jul 07 15:19:30 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Deleted volume successfully. Jul 07 15:19:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222406c3-789c-49da-b231-3da4f8a4273c tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-c19aa38a-8d10-4421-8fbe-ab1a85242a48-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:31 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29" returned: 0 in 0.852s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:31 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29 Jul 07 15:19:31 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Creating offline snapshot db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 of volume cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd082dd6-e607-49a3-83da-ac49845ca8b1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:32 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-19a51325-0cc2-468c-9e67-5d1c4f816b29" returned: 0 in 0.693s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-quobyte-19a51325-0cc2-468c-9e67-5d1c4f816b29" released by "delete_volume" :: held 1.611s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:32 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:19:32 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Created reservations ['1effd3e2-dffe-4d48-94d9-b725c29ac087', 'a74c7e50-dd6c-4016-9e86-cb7b42e79878', '151b1dd0-48b9-42e4-8d2c-17a0077061df', 'ae4ff091-23cd-481c-8607-0dae4ace8b05'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:32 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:32 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "cinder-9141f551-890e-447c-8803-18dca4ef22e3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-9141f551-890e-447c-8803-18dca4ef22e3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "cinder-quobyte-9141f551-890e-447c-8803-18dca4ef22e3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-quobyte-9141f551-890e-447c-8803-18dca4ef22e3" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a0b90b-6720-42c2-95c8-3cbd5657a91d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:33 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 Jul 07 15:19:33 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:33 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 1.026s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:33 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 1G Jul 07 15:19:33 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:33 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.926s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:33 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Deleted volume successfully. Jul 07 15:19:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cb02649-45c9-4e49-bf95-3bfd47291d77 tempest-CreateVolumesFromImageTest-17305972 None] Lock "cinder-19a51325-0cc2-468c-9e67-5d1c4f816b29-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:33 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3" returned: 0 in 1.092s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:33 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3 Jul 07 15:19:33 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:34 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 1G" returned: 0 in 1.070s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd02df2f-b59a-4934-a86c-286164078589 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:34 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd02df2f-b59a-4934-a86c-286164078589 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 Jul 07 15:19:34 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:34 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9141f551-890e-447c-8803-18dca4ef22e3" returned: 0 in 0.785s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-quobyte-9141f551-890e-447c-8803-18dca4ef22e3" released by "delete_volume" :: held 1.941s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Created reservations ['2cb55b86-1b0f-45cc-8b74-c4aaa06bafb5', '48016ea4-a58c-4295-ba3d-55c896abbb87', '98aae892-d519-4eca-85d4-856b72d6e662', '2fa91ab2-49b0-489d-9be2-9ee46a250757'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:35 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:35 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:35 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd02df2f-b59a-4934-a86c-286164078589 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" returned: 0 in 0.907s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:35 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 is being set with open permissions: ugo+rw Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:35 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 Jul 07 15:19:35 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "cinder-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "cinder-quobyte-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-quobyte-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b950b06-768a-4e4a-839b-2122a6179926]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:35 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f Jul 07 15:19:35 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:35 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.897s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:35 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Deleted volume successfully. Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" returned: 0 in 0.847s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-20a508e1-853a-420f-9dc1-6db50ea1b799 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-9141f551-890e-447c-8803-18dca4ef22e3-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:35 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.info Jul 07 15:19:35 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:36 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f" returned: 0 in 0.925s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:36 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f Jul 07 15:19:36 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:36 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.info" returned: 0 in 0.794s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:36 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.info is being set with open permissions: ugo+rw Jul 07 15:19:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:36 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.info Jul 07 15:19:36 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:36 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f" returned: 0 in 0.695s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-quobyte-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f" released by "delete_volume" :: held 1.673s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Created reservations ['627db80f-8d27-46d0-9624-e35731ee0ecd', 'e966cc3f-5815-4a25-83ee-3a32dd9129ac', '96f056ca-2bc7-47a1-8816-9e60ed0f1089', '93e41885-9592-488b-9a31-3fdfda97d60b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:37 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:37 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Flow 'volume_create_manager' (716f8407-1147-4173-8563-cfc87827597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20683608-3b5a-4319-8624-9c71d2eb92ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20683608-3b5a-4319-8624-9c71d2eb92ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103287237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bda862-f955-45fb-8e75-e302943c8d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbd3c3037e247d79f4a64cc385c76d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:37Z,use_quota=True,user_id='6130170d3bf54868a7898f8ce3ac820f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744c55ae-682e-4c0d-9b39-5216936a1f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744c55ae-682e-4c0d-9b39-5216936a1f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f6ffcc-0436-4965-a006-72ce7ec55a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f6ffcc-0436-4965-a006-72ce7ec55a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bda862-f955-45fb-8e75-e302943c8d99', 'volume_name': 'volume-84bda862-f955-45fb-8e75-e302943c8d99', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a636945-c0a7-4934-bb4a-c63046ea1c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a636945-c0a7-4934-bb4a-c63046ea1c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fba4002-36ed-4474-9cb5-aae750b417e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:37 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Volume 84bda862-f955-45fb-8e75-e302943c8d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bda862-f955-45fb-8e75-e302943c8d99', 'volume_size': 1} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "cinder-2ca0f56e-28fe-4202-927a-aebb2c36594e-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-2ca0f56e-28fe-4202-927a-aebb2c36594e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:37 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.info" returned: 0 in 0.798s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.571s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103287237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bda862-f955-45fb-8e75-e302943c8d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbd3c3037e247d79f4a64cc385c76d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:37Z,use_quota=True,user_id='6130170d3bf54868a7898f8ce3ac820f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Creating volume 84bda862-f955-45fb-8e75-e302943c8d99 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:37 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "cinder-quobyte-2ca0f56e-28fe-4202-927a-aebb2c36594e" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:37 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 1073741824 Jul 07 15:19:37 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-dae41626-e304-4426-abc4-fec2a5134c97 tempest-TestStampPattern-1153125313 None] Create snapshot completed successfully Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-quobyte-2ca0f56e-28fe-4202-927a-aebb2c36594e" acquired by "delete_volume" :: waited 0.039s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe703de-adfb-459f-88be-2df05ac68593]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:37 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e Jul 07 15:19:37 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:37 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Deleted volume successfully. Jul 07 15:19:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1fb7606d-45c3-4765-8817-1bd2ab4a5608 tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-a151c27d-d0aa-40b7-98c1-abdbe15e3c4f-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:38 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 1073741824" returned: 0 in 0.969s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:38 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e" returned: 0 in 0.913s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:38 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e Jul 07 15:19:38 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:38 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 Jul 07 15:19:38 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:39 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99" returned: 0 in 0.871s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fba4002-36ed-4474-9cb5-aae750b417e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bda862-f955-45fb-8e75-e302943c8d99', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89df6ae1-d3cf-4bf9-b090-280618b96458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:39 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2ca0f56e-28fe-4202-927a-aebb2c36594e" returned: 0 in 0.927s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Volume volume-84bda862-f955-45fb-8e75-e302943c8d99 (84bda862-f955-45fb-8e75-e302943c8d99): created successfully Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89df6ae1-d3cf-4bf9-b090-280618b96458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Flow 'volume_create_manager' (716f8407-1147-4173-8563-cfc87827597e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-quobyte-2ca0f56e-28fe-4202-927a-aebb2c36594e" released by "delete_volume" :: held 1.902s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4575680f-8773-4c26-add6-d5b3ed643f31 tempest-ProjectReaderTests-26668753 None] Created volume successfully. Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Created reservations ['7d445fef-63b5-40d9-a6ad-4e72b76592d1', 'd5444d39-035c-4bac-bc73-e7889c4ac868', '6322f842-706f-4a15-b6e5-32584cd3bfbf', '18cf3fc0-8195-4869-9872-a14804294506'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:39 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:39 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.987s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:40 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:40 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Deleted volume successfully. Jul 07 15:19:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cefc05c-de03-4f24-a844-0b9919938f1f tempest-VolumesListTestJSON-1976389235 None] Lock "cinder-2ca0f56e-28fe-4202-927a-aebb2c36594e-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Acquiring lock "cinder-84bda862-f955-45fb-8e75-e302943c8d99-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Lock "cinder-84bda862-f955-45fb-8e75-e302943c8d99-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Acquiring lock "cinder-quobyte-84bda862-f955-45fb-8e75-e302943c8d99" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Lock "cinder-quobyte-84bda862-f955-45fb-8e75-e302943c8d99" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:41 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4fd322-4a17-4add-b73d-c8f434a8b056]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:41 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 Jul 07 15:19:41 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:42 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99" returned: 0 in 0.989s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:42 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99 Jul 07 15:19:42 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:42 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84bda862-f955-45fb-8e75-e302943c8d99" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Lock "cinder-quobyte-84bda862-f955-45fb-8e75-e302943c8d99" released by "delete_volume" :: held 1.770s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:42 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Created reservations ['d88b080c-b316-46a8-a45d-1ed37c1de409', '458365a2-8fa5-463d-aa64-9cff30e195de', 'fba1f1c7-21d1-4add-8016-b3920a0d3137', '1c1b169c-7ec1-47d1-bfd2-e155cd7e4f67'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:43 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:43 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Flow 'volume_create_manager' (da6c090c-04f0-4640-8305-96540d111e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c221c36a-05a8-4163-8a0d-7ff16dd93b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c221c36a-05a8-4163-8a0d-7ff16dd93b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1449447010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77796999-b6bc-4337-b40c-b00e2ac5e205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e770aaf399b4c4d8aed663408500d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:44Z,use_quota=True,user_id='ebfb724c91ec40c1a86b5363292be58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767824d3-de58-460e-8c8e-fd63abf436f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767824d3-de58-460e-8c8e-fd63abf436f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6f81d1-46f1-4c16-93ad-8d3bc0605b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6f81d1-46f1-4c16-93ad-8d3bc0605b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77796999-b6bc-4337-b40c-b00e2ac5e205', 'volume_name': 'volume-77796999-b6bc-4337-b40c-b00e2ac5e205', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abfb672-ed5b-43c6-b70e-6071070747d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abfb672-ed5b-43c6-b70e-6071070747d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235841f4-bae1-40e1-b58d-c45734d3901b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Volume 77796999-b6bc-4337-b40c-b00e2ac5e205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77796999-b6bc-4337-b40c-b00e2ac5e205', 'volume_size': 1} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1449447010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77796999-b6bc-4337-b40c-b00e2ac5e205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e770aaf399b4c4d8aed663408500d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:44Z,use_quota=True,user_id='ebfb724c91ec40c1a86b5363292be58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Creating volume 77796999-b6bc-4337-b40c-b00e2ac5e205 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:43 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 1073741824 Jul 07 15:19:43 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Flow 'volume_create_manager' (bfbd9408-0296-4977-ab2e-9262c976150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628bb639-0968-409d-b79f-93fa601b0f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628bb639-0968-409d-b79f-93fa601b0f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893463402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d38713-2d26-4e86-9e01-da8df214719b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbd3c3037e247d79f4a64cc385c76d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:44Z,use_quota=True,user_id='6130170d3bf54868a7898f8ce3ac820f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0950693-06df-4d3e-96a8-fea0b644123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0950693-06df-4d3e-96a8-fea0b644123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413a363e-466e-48b2-aac6-752013ae65ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413a363e-466e-48b2-aac6-752013ae65ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d38713-2d26-4e86-9e01-da8df214719b', 'volume_name': 'volume-47d38713-2d26-4e86-9e01-da8df214719b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ce6b0b-adff-4c20-9a46-552ca2a7c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:44 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ce6b0b-adff-4c20-9a46-552ca2a7c3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd83110-3e91-4134-bb9c-c2aa2fb8c85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Volume 47d38713-2d26-4e86-9e01-da8df214719b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d38713-2d26-4e86-9e01-da8df214719b', 'volume_size': 1} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.113s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Deleted volume successfully. Jul 07 15:19:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c9b20076-a3a0-407c-b2d3-1316557d4e3b tempest-ProjectReaderTests-26668753 None] Lock "cinder-84bda862-f955-45fb-8e75-e302943c8d99-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:45 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 1073741824" returned: 0 in 1.248s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:45 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 Jul 07 15:19:45 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:45 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205" returned: 0 in 0.785s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893463402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d38713-2d26-4e86-9e01-da8df214719b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbd3c3037e247d79f4a64cc385c76d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:44Z,use_quota=True,user_id='6130170d3bf54868a7898f8ce3ac820f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Creating volume 47d38713-2d26-4e86-9e01-da8df214719b {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:45 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:45 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b 1073741824 Jul 07 15:19:45 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235841f4-bae1-40e1-b58d-c45734d3901b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77796999-b6bc-4337-b40c-b00e2ac5e205', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b750a7e1-0bc4-4553-a1ae-98ab6da33403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Volume volume-77796999-b6bc-4337-b40c-b00e2ac5e205 (77796999-b6bc-4337-b40c-b00e2ac5e205): created successfully Jul 07 15:19:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b750a7e1-0bc4-4553-a1ae-98ab6da33403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Flow 'volume_create_manager' (da6c090c-04f0-4640-8305-96540d111e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8cc7927e-1267-4335-b15d-d5ffc2b97989 tempest-VolumesNegativeTest-685013039 None] Created volume successfully. Jul 07 15:19:46 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b 1073741824" returned: 0 in 1.000s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:47 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b Jul 07 15:19:47 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:48 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b" returned: 0 in 1.265s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:19:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd83110-3e91-4134-bb9c-c2aa2fb8c85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d38713-2d26-4e86-9e01-da8df214719b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7fdd83-4657-4a81-ba27-8d3f0fadc788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:48 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Volume volume-47d38713-2d26-4e86-9e01-da8df214719b (47d38713-2d26-4e86-9e01-da8df214719b): created successfully Jul 07 15:19:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7fdd83-4657-4a81-ba27-8d3f0fadc788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Flow 'volume_create_manager' (bfbd9408-0296-4977-ab2e-9262c976150c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7239699c-cf8c-4b17-9bab-a0dfa187f914 tempest-ProjectReaderTests-26668753 None] Created volume successfully. Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Acquiring lock "cinder-47d38713-2d26-4e86-9e01-da8df214719b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Lock "cinder-47d38713-2d26-4e86-9e01-da8df214719b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Acquiring lock "cinder-quobyte-47d38713-2d26-4e86-9e01-da8df214719b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Lock "cinder-quobyte-47d38713-2d26-4e86-9e01-da8df214719b" acquired by "delete_volume" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7290ad59-8297-4df5-a09f-e154b2c0a634]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:49 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b Jul 07 15:19:49 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9919d1be-4f44-4df6-94c0-86a34784f27f tempest-VolumesActionsTest-1688544316 None] Acquiring lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d" by "attach_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9919d1be-4f44-4df6-94c0-86a34784f27f tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d" acquired by "attach_volume" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9919d1be-4f44-4df6-94c0-86a34784f27f tempest-VolumesActionsTest-1688544316 None] Attaching volume b08a914e-5f0e-42c5-9579-e8441498272d to instance beea4ad1-3544-4dd0-958f-345aac9ab51e at mountpoint /dev/vdb on host None. Jul 07 15:19:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9919d1be-4f44-4df6-94c0-86a34784f27f tempest-VolumesActionsTest-1688544316 None] Attach volume completed successfully. Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9919d1be-4f44-4df6-94c0-86a34784f27f tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d" released by "attach_volume" :: held 0.210s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Flow 'volume_create_manager' (f5286d25-4d8c-4b22-a99e-d3b83de416ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e302f10-6eb5-4316-8ebc-1845cda3084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e302f10-6eb5-4316-8ebc-1845cda3084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1171891426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f689058a-c0c3-4607-bc9c-661d08e89913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc817e39ed24dd8b8e2dd44cc728c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db9d66cb-5703-4d87-a6ad-8ce638a8fbc0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:19:50Z,use_quota=True,user_id='c266fbb79aae43be91c7dda7f1e2abd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c76c1a4-40ce-4cc7-9a20-c3855b1a8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c76c1a4-40ce-4cc7-9a20-c3855b1a8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0e915-bd7c-4c66-882c-d3fc84cf3aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0e915-bd7c-4c66-882c-d3fc84cf3aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f689058a-c0c3-4607-bc9c-661d08e89913', 'volume_name': 'volume-f689058a-c0c3-4607-bc9c-661d08e89913', 'volume_size': 1, 'snapshot_id': 'db9d66cb-5703-4d87-a6ad-8ce638a8fbc0'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4ca5b0-9b95-452b-94b4-ff778d479d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4ca5b0-9b95-452b-94b4-ff778d479d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6589cae-f870-4e78-ac82-9aaa08f21dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:19:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Volume f689058a-c0c3-4607-bc9c-661d08e89913: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f689058a-c0c3-4607-bc9c-661d08e89913', 'volume_size': 1, 'snapshot_id': 'db9d66cb-5703-4d87-a6ad-8ce638a8fbc0'} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-quobyte-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0-f689058a-c0c3-4607-bc9c-661d08e89913" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0-f689058a-c0c3-4607-bc9c-661d08e89913" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Creating volume f689058a-c0c3-4607-bc9c-661d08e89913 from snapshot db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-quobyte-f689058a-c0c3-4607-bc9c-661d08e89913" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-f689058a-c0c3-4607-bc9c-661d08e89913" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] snapshot: db9d66cb-5703-4d87-a6ad-8ce638a8fbc0, volume: f689058a-c0c3-4607-bc9c-661d08e89913, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44caa90-431f-41de-8693-2b8011f11916]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c7454f81-7533-419f-af7c-43246e494c86 tempest-VolumesActionsTest-1688544316 None] Acquiring lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-detach_volume" by "detach_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c7454f81-7533-419f-af7c-43246e494c86 tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:19:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c7454f81-7533-419f-af7c-43246e494c86 tempest-VolumesActionsTest-1688544316 None] Detaching volume b08a914e-5f0e-42c5-9579-e8441498272d from instance beea4ad1-3544-4dd0-958f-345aac9ab51e. Jul 07 15:19:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c7454f81-7533-419f-af7c-43246e494c86 tempest-VolumesActionsTest-1688544316 None] Detach volume completed successfully. Jul 07 15:19:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c7454f81-7533-419f-af7c-43246e494c86 tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:50 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 Jul 07 15:19:50 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:51 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b" returned: 0 in 1.425s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:51 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b Jul 07 15:19:51 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:52 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" returned: 0 in 1.453s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd02df2f-b59a-4934-a86c-286164078589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0d6737-a2b2-4647-8f13-08795f7443aa]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:52 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-47d38713-2d26-4e86-9e01-da8df214719b" returned: 0 in 1.189s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Lock "cinder-quobyte-47d38713-2d26-4e86-9e01-da8df214719b" released by "delete_volume" :: held 2.701s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:19:52 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:19:52 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Created reservations ['c8cd57f1-7024-412f-aa33-4e6fadb095a9', '4205df7a-1cfd-4d29-a7ad-42fbb76cc52a', '8c55be80-f04b-4ec2-8947-34ee73af496f', '1aeb36ff-a8e8-49f8-a03d-c8ba98c6b8f3'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:19:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:52 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:19:52 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:53 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 1.109s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:53 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:19:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:19:53 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 Jul 07 15:19:53 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:19:53 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 07 15:19:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.303s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:19:53 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:19:53 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Deleted volume successfully. Jul 07 15:19:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-03b4d8af-920f-47aa-9d79-de68aa2a8291 tempest-ProjectReaderTests-26668753 None] Lock "cinder-47d38713-2d26-4e86-9e01-da8df214719b-delete_volume" released by "delete_volume" :: held 4.341s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:20:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:00 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:20:00 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:01 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913" returned: 0 in 8.009s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1eb45-e4c2-4b79-9919-e4ab035a75b8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:01 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:20:01 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:01 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.618s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 28 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:20:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:20:02 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=66,cinder:INSERT=19,cinder:UPDATE=83,cinder:DELETE=4 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:20:03 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 1.858s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:20:03 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Converted 1024.00 MB image at 127.70 MB/s Jul 07 15:20:03 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 is being set with open permissions: ugo+rw Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:03 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 Jul 07 15:20:03 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=54,cinder:INSERT=20,cinder:UPDATE=78,cinder:DELETE=9 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (7ddfa524-bb14-492a-bb55-3769159b3d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feb97da-9001-4bc3-8f1c-641b6e2297d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feb97da-9001-4bc3-8f1c-641b6e2297d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437074009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87e3c08-d10a-4083-bfa9-2b745fdbf543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:04Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d14824f-b171-474b-bcda-b611bbf7954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d14824f-b171-474b-bcda-b611bbf7954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209c5f3e-6f21-4a4c-91a2-070346bfa2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209c5f3e-6f21-4a4c-91a2-070346bfa2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87e3c08-d10a-4083-bfa9-2b745fdbf543', 'volume_name': 'volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258f9db6-68a4-4f82-b855-b645aa87ca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258f9db6-68a4-4f82-b855-b645aa87ca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf48b11c-be59-4754-aa01-a1b0fdbe120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:04 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Volume a87e3c08-d10a-4083-bfa9-2b745fdbf543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543', 'volume_size': 1} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:04 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913" returned: 0 in 0.995s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-f689058a-c0c3-4607-bc9c-661d08e89913" released by "_copy_volume_from_snapshot" :: held 13.643s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0-f689058a-c0c3-4607-bc9c-661d08e89913" released by "_create_volume_from_snapshot" :: held 13.705s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.725s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437074009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87e3c08-d10a-4083-bfa9-2b745fdbf543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:04Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Creating volume a87e3c08-d10a-4083-bfa9-2b745fdbf543 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:20:04 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:04 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 1073741824 Jul 07 15:20:04 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6589cae-f870-4e78-ac82-9aaa08f21dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f689058a-c0c3-4607-bc9c-661d08e89913', 'volume_size': 1, 'snapshot_id': 'db9d66cb-5703-4d87-a6ad-8ce638a8fbc0'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adddb8a-9b64-4ec6-bf3a-d1e3b7bf60ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:04 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Volume volume-f689058a-c0c3-4607-bc9c-661d08e89913 (f689058a-c0c3-4607-bc9c-661d08e89913): created successfully Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adddb8a-9b64-4ec6-bf3a-d1e3b7bf60ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Flow 'volume_create_manager' (f5286d25-4d8c-4b22-a99e-d3b83de416ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:04 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0cab4e2a-cc62-4e72-803f-e699effd766f tempest-TestStampPattern-1153125313 None] Created volume successfully. Jul 07 15:20:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:05 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 1073741824" returned: 0 in 1.440s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:05 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 Jul 07 15:20:05 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:06 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543" returned: 0 in 0.711s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.199s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf48b11c-be59-4754-aa01-a1b0fdbe120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa58aa8d-65a5-4af6-a3d4-be7bed4b6ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7758938-d8f7-4c2f-a4ee-b67d31a25793]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:06 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Volume volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 (a87e3c08-d10a-4083-bfa9-2b745fdbf543): created successfully Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa58aa8d-65a5-4af6-a3d4-be7bed4b6ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (7ddfa524-bb14-492a-bb55-3769159b3d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ccf13d25-26ba-4b3e-a404-04c2cc529e02 tempest-ProjectReaderTests-1875050511 None] Created volume successfully. Jul 07 15:20:06 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:06 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-a87e3c08-d10a-4083-bfa9-2b745fdbf543-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:07 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 0.806s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Lock "cinder-a87e3c08-d10a-4083-bfa9-2b745fdbf543-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[da906b76-35a6-4397-873f-ffc5edeb1316]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-quobyte-a87e3c08-d10a-4083-bfa9-2b745fdbf543" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-a87e3c08-d10a-4083-bfa9-2b745fdbf543" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f06fccd-5529-4eef-8568-423207c06fb4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:07 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:07 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:07 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 Jul 07 15:20:07 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:08 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543" returned: 0 in 1.204s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:08 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543 Jul 07 15:20:08 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:09 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 1.879s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.90869d31-a237-4503-882a-3eb7ed8994d3nqa1i4iy.img {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:09 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.90869d31-a237-4503-882a-3eb7ed8994d3nqa1i4iy.img Jul 07 15:20:09 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:09 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a87e3c08-d10a-4083-bfa9-2b745fdbf543" returned: 0 in 1.003s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-a87e3c08-d10a-4083-bfa9-2b745fdbf543" released by "delete_volume" :: held 2.308s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Created reservations ['d326498d-3aa9-4bc9-b09d-d00ff6806751', 'ea385687-dbd7-461a-8c74-8f5efda34547', 'fe518e78-7377-450b-a0a1-4df882820c8e', '0f9d2007-e66b-41d9-84a9-e64e16f2de8c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:10 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:20:10 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:11 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.354s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:11 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:20:11 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Deleted volume successfully. Jul 07 15:20:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bb3adefe-11b4-4c5d-8dba-7092e6299bba tempest-ProjectReaderTests-1875050511 None] Lock "cinder-a87e3c08-d10a-4083-bfa9-2b745fdbf543-delete_volume" released by "delete_volume" :: held 4.167s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (465f83d7-f74e-4550-9a96-e704967c8981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0a9835-3e9b-4a7c-85d0-4f2522eadde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0a9835-3e9b-4a7c-85d0-4f2522eadde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551596891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2c567d-a761-4a18-bf1e-0b49d33b446a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:13Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d984d55-288b-450f-9b74-6f25f9117827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d984d55-288b-450f-9b74-6f25f9117827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7305bd2f-80be-4156-81ff-5c9bfa2cf98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7305bd2f-80be-4156-81ff-5c9bfa2cf98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2c567d-a761-4a18-bf1e-0b49d33b446a', 'volume_name': 'volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad7795-8ff2-47dc-93da-572079a20daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad7795-8ff2-47dc-93da-572079a20daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84932790-6b1b-4937-bb4d-51b015d7e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:13 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Volume 5d2c567d-a761-4a18-bf1e-0b49d33b446a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a', 'volume_size': 1} Jul 07 15:20:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:18 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.90869d31-a237-4503-882a-3eb7ed8994d3nqa1i4iy.img" returned: 0 in 8.837s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47f0958-c750-4637-a118-ef5d042ef5f8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:18 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:18 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:19 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 1.067s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:19 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.90869d31-a237-4503-882a-3eb7ed8994d3nqa1i4iy.img {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:20:19 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Converted 1024.00 MB image at 115.86 MB/s Jul 07 15:20:19 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] 90869d31-a237-4503-882a-3eb7ed8994d3 was raw, no need to convert to raw {{(pid=87257) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 15:20:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Acquiring lock "cinder-77796999-b6bc-4337-b40c-b00e2ac5e205-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Lock "cinder-77796999-b6bc-4337-b40c-b00e2ac5e205-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Acquiring lock "cinder-quobyte-77796999-b6bc-4337-b40c-b00e2ac5e205" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Lock "cinder-quobyte-77796999-b6bc-4337-b40c-b00e2ac5e205" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:27 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c8ee3-efab-417d-8e10-921fb69100b8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:27 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 Jul 07 15:20:27 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:28 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205" returned: 0 in 0.787s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:28 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205 Jul 07 15:20:28 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:28 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-77796999-b6bc-4337-b40c-b00e2ac5e205" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Lock "cinder-quobyte-77796999-b6bc-4337-b40c-b00e2ac5e205" released by "delete_volume" :: held 1.552s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Created reservations ['7edd7a6f-a2f7-44dd-89de-aae10b87a4e5', '4de93868-32c6-40e3-8497-b5c5fa77ffd2', 'c18112b8-cfee-4985-9705-67060a8856d2', '0a2cc95d-40ed-4b13-a90b-0f51748599d4'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:29 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:20:29 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:29 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.776s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:29 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:20:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Deleted volume successfully. Jul 07 15:20:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-745de16c-8ff7-4fd2-97b4-1eb19e944163 tempest-VolumesNegativeTest-685013039 None] Lock "cinder-77796999-b6bc-4337-b40c-b00e2ac5e205-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Flow 'volume_create_manager' (57ee66bc-ab4f-4852-afd6-107125e060a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63042337-67ab-4d9d-8bca-d027faa2919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63042337-67ab-4d9d-8bca-d027faa2919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1798019175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a7bf4b-e5dc-4672-893d-d92d116b539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d847fa1c2b64d39b814ae80b807160c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:33Z,use_quota=True,user_id='b00dec06ffc14711b10253c7caf6701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc12692-ebad-4364-a336-f2c41391946c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc12692-ebad-4364-a336-f2c41391946c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817ffafc-f700-49ba-a323-c54313c1d859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817ffafc-f700-49ba-a323-c54313c1d859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a7bf4b-e5dc-4672-893d-d92d116b539f', 'volume_name': 'volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f', 'volume_size': 2}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c993c-37a3-4b59-8611-c9f7431d2acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7c993c-37a3-4b59-8611-c9f7431d2acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fa9dee-4c88-4c5f-ba3e-09e26a8d2ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:33 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Volume d9a7bf4b-e5dc-4672-893d-d92d116b539f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f', 'volume_size': 2} Jul 07 15:20:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.516s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Uploaded volume to glance image-id: 90869d31-a237-4503-882a-3eb7ed8994d3. {{(pid=87257) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.231s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551596891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2c567d-a761-4a18-bf1e-0b49d33b446a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:13Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Creating volume 5d2c567d-a761-4a18-bf1e-0b49d33b446a {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:20:39 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:20:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:40 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a 1073741824 Jul 07 15:20:40 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e46d7b1f-e238-4aed-9634-40ec128781eb tempest-VolumesActionsTest-1688544316 None] Copy volume to image completed successfully. Jul 07 15:20:40 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a 1073741824" returned: 0 in 0.886s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:40 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a Jul 07 15:20:40 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:41 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a" returned: 0 in 0.665s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.322s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1798019175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a7bf4b-e5dc-4672-893d-d92d116b539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d847fa1c2b64d39b814ae80b807160c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:33Z,use_quota=True,user_id='b00dec06ffc14711b10253c7caf6701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Creating volume d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:20:41 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f 2147483648 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84932790-6b1b-4937-bb4d-51b015d7e340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4d106d-9492-477d-bd35-88fc41b1acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:41 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f 2147483648 Jul 07 15:20:41 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:41 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Volume volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a (5d2c567d-a761-4a18-bf1e-0b49d33b446a): created successfully Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4d106d-9492-477d-bd35-88fc41b1acd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (465f83d7-f74e-4550-9a96-e704967c8981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-eda86142-1f7e-4836-a458-f264df08fccb tempest-ProjectReaderTests-1875050511 None] Created volume successfully. Jul 07 15:20:42 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f 2147483648" returned: 0 in 0.959s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:42 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f Jul 07 15:20:42 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-5d2c567d-a761-4a18-bf1e-0b49d33b446a-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-5d2c567d-a761-4a18-bf1e-0b49d33b446a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-f92e382b-cf5f-4d00-8cb8-0594cf13b0cf req-9bb4dcd6-6261-4625-88a9-c93f5453c3ad tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-quobyte-5d2c567d-a761-4a18-bf1e-0b49d33b446a" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-5d2c567d-a761-4a18-bf1e-0b49d33b446a" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[28faa810-68f7-4fd2-b283-3338f7a8c8e6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:43 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a Jul 07 15:20:43 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:43 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f" returned: 0 in 0.733s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fa9dee-4c88-4c5f-ba3e-09e26a8d2ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f', 'volume_size': 2}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72e5e09-37cd-43e7-9889-11b46adc9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[790050a6-268a-4c97-8d3f-a49da4681715]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Volume volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f (d9a7bf4b-e5dc-4672-893d-d92d116b539f): created successfully Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72e5e09-37cd-43e7-9889-11b46adc9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Flow 'volume_create_manager' (57ee66bc-ab4f-4852-afd6-107125e060a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d30d2c86-2d3c-4ece-be4b-64578e4fa959 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Created volume successfully. Jul 07 15:20:43 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:43 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:43 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a" returned: 0 in 0.837s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:43 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a Jul 07 15:20:43 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:44 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 0.842s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0cfc22-41f2-47eb-abec-a56f1b83d02a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:44 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:44 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:44 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5d2c567d-a761-4a18-bf1e-0b49d33b446a" returned: 0 in 0.700s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-5d2c567d-a761-4a18-bf1e-0b49d33b446a" released by "delete_volume" :: held 1.591s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Created reservations ['5f6efe5a-b060-4f1b-a541-95a2c7e38a13', '0c89fb53-5e3f-468a-a683-103a143ecd24', '58cc16eb-ba4a-4ab5-a3ef-7453bf287ab2', '2147453d-074e-4d32-8e89-71b2866dfeea'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:44 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:20:44 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:44 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:45 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img Jul 07 15:20:45 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:45 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.705s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:20:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Deleted volume successfully. Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fac6d3d0-bd50-48cf-8d12-08745e71e6e7 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-5d2c567d-a761-4a18-bf1e-0b49d33b446a-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (fb5e11e1-a348-4dd4-aa24-52b2da950f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bd74cf-b0a0-43c3-8562-ddd8b626d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bd74cf-b0a0-43c3-8562-ddd8b626d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392712806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2831959b-1193-4ece-8abb-5a69f0953132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:46Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac170024-63da-4230-8c17-3833d59b1cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac170024-63da-4230-8c17-3833d59b1cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2e7471-c25f-4f48-a6d8-cdffb0d05378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2e7471-c25f-4f48-a6d8-cdffb0d05378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2831959b-1193-4ece-8abb-5a69f0953132', 'volume_name': 'volume-2831959b-1193-4ece-8abb-5a69f0953132', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8dd77c-8667-4c01-b2a2-9ff9b3c3e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8dd77c-8667-4c01-b2a2-9ff9b3c3e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e5bdcd-4177-4da1-8a8e-73d10cf4e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:20:45 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Volume 2831959b-1193-4ece-8abb-5a69f0953132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2831959b-1193-4ece-8abb-5a69f0953132', 'volume_size': 1} Jul 07 15:20:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:49 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img" returned: 0 in 4.605s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4d813-8917-439d-b71c-7789d3c4a551]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:49 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:49 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:50 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 0.913s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:50 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:20:50 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Converted 1024.00 MB image at 222.33 MB/s Jul 07 15:20:50 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9f was raw, converting to qcow2 {{(pid=87257) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 15:20:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c56464-3856-429e-bb4e-7fcf9474bc5f]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:50 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img Jul 07 15:20:50 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:51 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img" returned: 0 in 0.700s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:51 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img Jul 07 15:20:51 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:51 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img" returned: 1 in 0.715s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:20:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img /opt/stack/data/cinder/conversion/vol_upload_76_iu60u {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:52 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img /opt/stack/data/cinder/conversion/vol_upload_76_iu60u Jul 07 15:20:52 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:52 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img /opt/stack/data/cinder/conversion/vol_upload_76_iu60u" returned: 0 in 0.662s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:52 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Image conversion details: src /opt/stack/data/cinder/conversion/b08a914e-5f0e-42c5-9579-e8441498272d.temp_image.fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9fo02zt911.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_76_iu60u {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:20:52 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 15:20:52 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7287430d-30b7-4e33-896d-d4a3be2e0084]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_76_iu60u {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:52 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_76_iu60u Jul 07 15:20:52 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:53 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_76_iu60u" returned: 0 in 0.730s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.293s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Uploaded volume to glance image-id: fdea74ba-7d7e-4fb4-8a2c-4136b17a1c9f. {{(pid=87257) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 15:20:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-f92e382b-cf5f-4d00-8cb8-0594cf13b0cf req-9bb4dcd6-6261-4625-88a9-c93f5453c3ad tempest-TestStampPattern-1153125313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.726s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:54 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88a8e4-6fe9-4b7f-84c3-24abe3458aed]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-f92e382b-cf5f-4d00-8cb8-0594cf13b0cf req-9bb4dcd6-6261-4625-88a9-c93f5453c3ad tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7d30fbcd-184a-4810-8acb-a9447439a2fa tempest-VolumesActionsTest-1688544316 None] Copy volume to image completed successfully. Jul 07 15:20:54 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 Jul 07 15:20:54 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:55 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-f92e382b-cf5f-4d00-8cb8-0594cf13b0cf req-9bb4dcd6-6261-4625-88a9-c93f5453c3ad tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913" returned: 0 in 0.795s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-f92e382b-cf5f-4d00-8cb8-0594cf13b0cf req-9bb4dcd6-6261-4625-88a9-c93f5453c3ad tempest-TestStampPattern-1153125313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.398s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Creating offline snapshot bb3009b1-8b29-46b2-9703-0b9b8734b89e of volume d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac786db-9406-47e1-85a2-63ed293736fe]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Acquiring lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-f92e382b-cf5f-4d00-8cb8-0594cf13b0cf req-9bb4dcd6-6261-4625-88a9-c93f5453c3ad tempest-TestStampPattern-1153125313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-f689058a-c0c3-4607-bc9c-661d08e89913', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c92f7093-9e67-4096-8d30-5d9fbea7cb5d', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Acquiring lock "cinder-quobyte-b08a914e-5f0e-42c5-9579-e8441498272d" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:20:55 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f Jul 07 15:20:55 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Lock "cinder-quobyte-b08a914e-5f0e-42c5-9579-e8441498272d" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:20:55 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-f92e382b-cf5f-4d00-8cb8-0594cf13b0cf req-9bb4dcd6-6261-4625-88a9-c93f5453c3ad tempest-TestStampPattern-1153125313 None] attachment_update completed successfully. Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ddb419-01c5-4897-ab5a-3389a41c2518]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:20:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:55 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:55 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:56 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f" returned: 0 in 0.829s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e 2G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:56 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e 2G Jul 07 15:20:56 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:56 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 0.771s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:56 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d Jul 07 15:20:56 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:57 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b08a914e-5f0e-42c5-9579-e8441498272d" returned: 0 in 0.693s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Lock "cinder-quobyte-b08a914e-5f0e-42c5-9579-e8441498272d" released by "delete_volume" :: held 1.512s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:57 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e 2G" returned: 0 in 0.835s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:57 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e Jul 07 15:20:57 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Created reservations ['15e3511b-b721-403b-934f-b14e1dc79f10', 'c56ab24a-9b5a-476f-a1a9-56a1a6b964db', '7edf9014-faef-4770-ad75-d18cbc8e4d2c', '1645485a-1794-433b-b663-5064641084e4'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:57 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:20:57 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:57 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e" returned: 0 in 0.704s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:57 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e is being set with open permissions: ugo+rw Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:57 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e Jul 07 15:20:57 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:57 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.670s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:20:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Deleted volume successfully. Jul 07 15:20:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-88bf73ec-8005-4f6d-a31f-dff918a27b3d tempest-VolumesActionsTest-1688544316 None] Lock "cinder-b08a914e-5f0e-42c5-9579-e8441498272d-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:20:58 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e" returned: 0 in 0.681s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:58 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.info Jul 07 15:20:58 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:59 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 07 15:20:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.info" returned: 0 in 0.725s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:20:59 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.info is being set with open permissions: ugo+rw Jul 07 15:20:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:20:59 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.info Jul 07 15:20:59 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:20:59 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.info" returned: 0 in 0.724s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.599s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.282s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392712806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2831959b-1193-4ece-8abb-5a69f0953132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:20:46Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Creating volume 2831959b-1193-4ece-8abb-5a69f0953132 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:00 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:00 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 1073741824 Jul 07 15:21:00 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:00 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:00 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-48726726-543b-4c7b-ac87-27f06d0dde47 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Create snapshot completed successfully Jul 07 15:21:00 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.818s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 28 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:21:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "cinder-bb3009b1-8b29-46b2-9703-0b9b8734b89e-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-bb3009b1-8b29-46b2-9703-0b9b8734b89e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "cinder-quobyte-d9a7bf4b-e5dc-4672-893d-d92d116b539f" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-quobyte-d9a7bf4b-e5dc-4672-893d-d92d116b539f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "cinder-quobyte-bb3009b1-8b29-46b2-9703-0b9b8734b89e" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-quobyte-bb3009b1-8b29-46b2-9703-0b9b8734b89e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Deleting offline snapshot bb3009b1-8b29-46b2-9703-0b9b8734b89e of volume d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] snapshot_file for this snap is: volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca9ba4f-82d1-4c36-8c49-6fad94ac98be]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:01 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e Jul 07 15:21:01 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:01 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 1073741824" returned: 0 in 1.280s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:01 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 Jul 07 15:21:01 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:01 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e" returned: 0 in 0.844s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f8e5a8-83df-422f-b7c3-ad6cd4c97f0a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:02 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f Jul 07 15:21:02 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:02 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132" returned: 0 in 0.845s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e5bdcd-4177-4da1-8a8e-73d10cf4e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2831959b-1193-4ece-8abb-5a69f0953132', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd23ce7-52c9-42a5-b0d9-f7813cc1910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:02 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Volume volume-2831959b-1193-4ece-8abb-5a69f0953132 (2831959b-1193-4ece-8abb-5a69f0953132): created successfully Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd23ce7-52c9-42a5-b0d9-f7813cc1910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (fb5e11e1-a348-4dd4-aa24-52b2da950f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:02 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9534225e-6c61-4f3a-bfd3-46ee4e695fe5 tempest-ProjectReaderTests-1875050511 None] Created volume successfully. Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=46,cinder:UPDATE=48,cinder:DELETE=6,cinder:INSERT=11 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:21:02 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-eb1b5191-9de0-4c9f-a292-bce3ab6a7aac req-313935e8-83ff-4ed7-8a97-2e854f733016 tempest-TestStampPattern-1153125313 None] Terminate volume connection completed successfully. Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-eb1b5191-9de0-4c9f-a292-bce3ab6a7aac req-313935e8-83ff-4ed7-8a97-2e854f733016 tempest-TestStampPattern-1153125313 None] Deleting attachment c92f7093-9e67-4096-8d30-5d9fbea7cb5d. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:21:02 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:02 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e Jul 07 15:21:02 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-2831959b-1193-4ece-8abb-5a69f0953132-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Lock "cinder-2831959b-1193-4ece-8abb-5a69f0953132-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-quobyte-2831959b-1193-4ece-8abb-5a69f0953132" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-2831959b-1193-4ece-8abb-5a69f0953132" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc81a8-8d72-44c1-950e-5bf0953f7e3f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:03 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 Jul 07 15:21:03 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:03 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e" returned: 0 in 0.798s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:03 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e Jul 07 15:21:03 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:04 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132" returned: 0 in 0.827s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:04 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132 Jul 07 15:21:04 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:04 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f.bb3009b1-8b29-46b2-9703-0b9b8734b89e" returned: 0 in 0.729s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=51,cinder:SELECT=41,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-quobyte-bb3009b1-8b29-46b2-9703-0b9b8734b89e" released by "_delete_snapshot" :: held 3.334s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-quobyte-d9a7bf4b-e5dc-4672-893d-d92d116b539f" released by "delete_snapshot" :: held 3.375s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Created reservations ['cc80377c-0563-4ae0-a256-06548b5eaf11', '6380f253-1b6b-45d5-86f7-a06b326405b0', 'ccf5b89d-3c1f-4580-8ceb-5d1769db33fc', '281783da-3b56-4e62-a1be-9fa10d49ca48'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Flow 'volume_create_manager' (f0237aa4-e4e1-499e-9864-f6c99ebbd404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d0c013-ef28-41a5-8528-ebc8a0aeac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d0c013-ef28-41a5-8528-ebc8a0aeac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1215076271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d424fa5f-6022-40ab-8181-1919a971e0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef97aedbe0843879afc2c2778ca729e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:04Z,use_quota=True,user_id='2f19fc331dfc4b8d834c076e7dcdb0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e432dc-0780-4c5d-868a-fca2f9c1229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e432dc-0780-4c5d-868a-fca2f9c1229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef542369-d855-45f3-a3c2-dfb8551eee51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef542369-d855-45f3-a3c2-dfb8551eee51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd424fa5f-6022-40ab-8181-1919a971e0ea', 'volume_name': 'volume-d424fa5f-6022-40ab-8181-1919a971e0ea', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e4ba7-0bdb-4514-af6a-96d3af69a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e4ba7-0bdb-4514-af6a-96d3af69a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9592e93b-e93e-4f33-83d3-4c7332986b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:04 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Volume d424fa5f-6022-40ab-8181-1919a971e0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d424fa5f-6022-40ab-8181-1919a971e0ea', 'volume_size': 1} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1215076271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d424fa5f-6022-40ab-8181-1919a971e0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef97aedbe0843879afc2c2778ca729e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:04Z,use_quota=True,user_id='2f19fc331dfc4b8d834c076e7dcdb0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Creating volume d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:04 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:04 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea 1073741824 Jul 07 15:21:04 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:04 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Delete snapshot completed successfully. Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6eb7fd5-bb04-4ea2-b347-15efa53558d3 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-bb3009b1-8b29-46b2-9703-0b9b8734b89e-delete_snapshot" released by "delete_snapshot" :: held 3.699s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:04 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2831959b-1193-4ece-8abb-5a69f0953132" returned: 0 in 0.769s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-2831959b-1193-4ece-8abb-5a69f0953132" released by "delete_volume" :: held 1.648s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Created reservations ['cde6416f-1510-4a75-90f8-f3ac19e8c859', '7b41418c-4da2-4b03-a7b1-44c5667290af', 'cbb3d989-3306-4fee-b063-debe01bb5e68', 'dc44e387-d3c8-4574-b63f-3853e7cf20ae'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:05 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:05 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "cinder-d9a7bf4b-e5dc-4672-893d-d92d116b539f-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-d9a7bf4b-e5dc-4672-893d-d92d116b539f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "cinder-quobyte-d9a7bf4b-e5dc-4672-893d-d92d116b539f" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-quobyte-d9a7bf4b-e5dc-4672-893d-d92d116b539f" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63744a-c4e1-4653-bdcb-b0bfc1d7ebb6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:05 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f Jul 07 15:21:05 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:05 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea 1073741824" returned: 0 in 1.221s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:06 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea Jul 07 15:21:06 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:06 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.088s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Deleted volume successfully. Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5f439c95-6e83-4a57-8f85-dda1a0443add tempest-ProjectReaderTests-1875050511 None] Lock "cinder-2831959b-1193-4ece-8abb-5a69f0953132-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (024bea6b-5ac2-4eeb-aed7-b1b73516ab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553daeb8-0dca-47b8-af34-23275e4ea9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553daeb8-0dca-47b8-af34-23275e4ea9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392698754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb69eaf-c33e-4f36-a9ce-624203430a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:06Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc493a9c-293e-4587-bf01-e6ee8e6d1c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc493a9c-293e-4587-bf01-e6ee8e6d1c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61e8c03-4dfb-4b13-873c-93e5c7e78152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61e8c03-4dfb-4b13-873c-93e5c7e78152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb69eaf-c33e-4f36-a9ce-624203430a36', 'volume_name': 'volume-9bb69eaf-c33e-4f36-a9ce-624203430a36', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17c3692-5db2-4231-abc9-7d4f252aa935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17c3692-5db2-4231-abc9-7d4f252aa935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42dd98e-cf8f-429d-a938-d84a72f4879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:06 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Volume 9bb69eaf-c33e-4f36-a9ce-624203430a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb69eaf-c33e-4f36-a9ce-624203430a36', 'volume_size': 1} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:06 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f" returned: 0 in 1.033s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:06 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f Jul 07 15:21:06 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:06 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea" returned: 0 in 0.863s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392698754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb69eaf-c33e-4f36-a9ce-624203430a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77aad670bd8b4c53b8a36aef7d911bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:06Z,use_quota=True,user_id='a40f54584ce443cdb6818e1f11a05f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Creating volume 9bb69eaf-c33e-4f36-a9ce-624203430a36 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:06 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9592e93b-e93e-4f33-83d3-4c7332986b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d424fa5f-6022-40ab-8181-1919a971e0ea', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:06 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 1073741824 Jul 07 15:21:06 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bdc7da-835c-441e-87c6-3d517744f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:06 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Volume volume-d424fa5f-6022-40ab-8181-1919a971e0ea (d424fa5f-6022-40ab-8181-1919a971e0ea): created successfully Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bdc7da-835c-441e-87c6-3d517744f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Flow 'volume_create_manager' (f0237aa4-e4e1-499e-9864-f6c99ebbd404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-906dae11-c445-4b29-82d6-e11397716bf1 tempest-VolumesCloneTest-474504405 None] Created volume successfully. Jul 07 15:21:07 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9a7bf4b-e5dc-4672-893d-d92d116b539f" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-quobyte-d9a7bf4b-e5dc-4672-893d-d92d116b539f" released by "delete_volume" :: held 1.849s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Created reservations ['b6512f2f-166e-4e58-9c12-e865d663581b', '3e2b8780-0c53-49c6-af68-ba27916ed970', '8d750035-6789-4b5f-a0f7-494bb81f465c', '6131ed26-f564-4c98-9d8a-7a76934010c5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:07 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:07 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:08 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 1073741824" returned: 0 in 1.260s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:08 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 Jul 07 15:21:08 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:08 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.262s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:08 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Deleted volume successfully. Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Flow 'volume_create_manager' (92acdef6-18db-4489-ad11-13d6c2eddc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65fff6b-2b84-4f28-b8ad-214d43707880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65fff6b-2b84-4f28-b8ad-214d43707880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-208307927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef97aedbe0843879afc2c2778ca729e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d424fa5f-6022-40ab-8181-1919a971e0ea,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:09Z,use_quota=True,user_id='2f19fc331dfc4b8d834c076e7dcdb0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d767fb-f9da-4c3e-880c-39a6e2ba36c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d767fb-f9da-4c3e-880c-39a6e2ba36c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed6b4bb-2088-49a1-9750-6625100b8caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ddc94e51-42a4-4a8d-861e-a83d6dfd9336 tempest-VolumesSnapshotNegativeTestJSON-379818008 None] Lock "cinder-d9a7bf4b-e5dc-4672-893d-d92d116b539f-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed6b4bb-2088-49a1-9750-6625100b8caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a', 'volume_name': 'volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a', 'volume_size': 2, 'source_volid': 'd424fa5f-6022-40ab-8181-1919a971e0ea', 'source_volstatus': 'available'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df501fc7-4cf3-4505-9994-884bae374ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df501fc7-4cf3-4505-9994-884bae374ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb83c5d-62d2-4536-8984-be655a827ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:09 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Volume eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a', 'volume_size': 2, 'source_volid': 'd424fa5f-6022-40ab-8181-1919a971e0ea', 'source_volstatus': 'available'} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:09 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36" returned: 0 in 1.081s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] <== create_volume: return (2426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.429s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.202s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:09 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Cloning volume d424fa5f-6022-40ab-8181-1919a971e0ea to volume eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42dd98e-cf8f-429d-a938-d84a72f4879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb69eaf-c33e-4f36-a9ce-624203430a36', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235b1687-bdf2-410b-9048-ada3c68ed7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:09 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Volume volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 (9bb69eaf-c33e-4f36-a9ce-624203430a36): created successfully Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235b1687-bdf2-410b-9048-ada3c68ed7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Flow 'volume_create_manager' (024bea6b-5ac2-4eeb-aed7-b1b73516ab6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Creating offline snapshot 47aab1a3-c353-4830-b557-c5c342cb6c91 of volume d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:21:09 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a2473440-db5c-4e04-bcc3-eb2fa2e9edd7 tempest-ProjectReaderTests-1875050511 None] Created volume successfully. Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d133f2d-5926-4600-975f-5d83c625dc18]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:09 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea Jul 07 15:21:09 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:10 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea" returned: 0 in 0.841s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:10 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 1G Jul 07 15:21:10 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-9bb69eaf-c33e-4f36-a9ce-624203430a36-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-9bb69eaf-c33e-4f36-a9ce-624203430a36-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "cinder-quobyte-9bb69eaf-c33e-4f36-a9ce-624203430a36" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-9bb69eaf-c33e-4f36-a9ce-624203430a36" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f2c9ea-fe99-4557-b62d-c70281b76cda]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:10 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 Jul 07 15:21:10 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:11 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 1G" returned: 0 in 0.945s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d424fa5f-6022-40ab-8181-1919a971e0ea -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:11 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d424fa5f-6022-40ab-8181-1919a971e0ea -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 Jul 07 15:21:11 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:11 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36" returned: 0 in 0.925s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:11 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36 Jul 07 15:21:11 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:12 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d424fa5f-6022-40ab-8181-1919a971e0ea -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91" returned: 0 in 0.866s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:12 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 is being set with open permissions: ugo+rw Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:12 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 Jul 07 15:21:12 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:12 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9bb69eaf-c33e-4f36-a9ce-624203430a36" returned: 0 in 0.787s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-quobyte-9bb69eaf-c33e-4f36-a9ce-624203430a36" released by "delete_volume" :: held 1.784s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Created reservations ['c6847982-f065-4dbd-9fb8-e478b3b8ff85', 'f4ecbbae-ba80-49c3-967f-21bbaf97490b', '6f38033a-8e83-4708-a24e-51220da7316f', 'cc25de26-8c57-461f-8791-dbf16c3c05c0'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:12 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:12 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:12 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91" returned: 0 in 0.791s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:12 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.info Jul 07 15:21:12 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-f689058a-c0c3-4607-bc9c-661d08e89913-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Lock "cinder-f689058a-c0c3-4607-bc9c-661d08e89913-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-quobyte-f689058a-c0c3-4607-bc9c-661d08e89913" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-f689058a-c0c3-4607-bc9c-661d08e89913" acquired by "delete_volume" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a99343c-1727-49c6-8ebb-d2faa7e645e8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:13 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.899s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Deleted volume successfully. Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ce9a29cd-8b87-4554-9ff1-dda1dff1b227 tempest-ProjectReaderTests-1875050511 None] Lock "cinder-9bb69eaf-c33e-4f36-a9ce-624203430a36-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:13 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 Jul 07 15:21:13 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:13 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.info" returned: 0 in 0.925s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:13 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.info is being set with open permissions: ugo+rw Jul 07 15:21:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:13 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.info Jul 07 15:21:13 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:14 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913" returned: 0 in 1.368s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:14 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913 Jul 07 15:21:14 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:14 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.info" returned: 0 in 1.086s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Acquiring lock "cinder-quobyte-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] snapshot: 47aab1a3-c353-4830-b557-c5c342cb6c91, volume: eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd87f25-ee72-46eb-819d-b2f3fb41d31a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:15 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 Jul 07 15:21:15 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:15 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f689058a-c0c3-4607-bc9c-661d08e89913" returned: 0 in 0.885s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-f689058a-c0c3-4607-bc9c-661d08e89913" released by "delete_volume" :: held 2.311s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Created reservations ['ca692a5b-37f7-4b35-9f2f-1e4165264397', 'fffdcb68-9038-4529-b6e1-96ef4da4202a', '29508bf3-e02a-45ac-b3fa-3022f1b526c0', 'ee61073c-3b84-4b30-be40-0f230e55df04'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:15 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:15 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:15 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91" returned: 0 in 0.990s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d424fa5f-6022-40ab-8181-1919a971e0ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08001f-3d97-4367-9e97-4c456419494c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:16 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea Jul 07 15:21:16 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:16 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.974s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:16 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:16 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Deleted volume successfully. Jul 07 15:21:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a311be6-88a9-4e61-8008-4794eb6efab6 tempest-TestStampPattern-1153125313 None] Lock "cinder-f689058a-c0c3-4607-bc9c-661d08e89913-delete_volume" released by "delete_volume" :: held 3.598s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Lock "cinder-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-quobyte-cd02df2f-b59a-4934-a86c-286164078589" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:17 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea" returned: 0 in 1.045s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-cd02df2f-b59a-4934-a86c-286164078589" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-quobyte-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:17 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a Jul 07 15:21:17 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Deleting offline snapshot db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 of volume cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] snapshot_file for this snap is: volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e75e09-f28a-40a8-8dcf-5c0acfb8d2b1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:17 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 Jul 07 15:21:17 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:17 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" returned: 0 in 0.843s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd02df2f-b59a-4934-a86c-286164078589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:21:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb07901-d3b0-4150-b3ed-133bc63aca40]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:18 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:21:18 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:19 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 1.623s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:19 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 Jul 07 15:21:19 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:21 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" returned: 0 in 1.774s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:21 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0 Jul 07 15:21:21 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:22 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589.db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" returned: 0 in 1.392s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:22 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" returned: 0 in 5.846s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0" released by "_delete_snapshot" :: held 5.805s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[338834eb-c324-4f80-b608-b1576d4a5207]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-cd02df2f-b59a-4934-a86c-286164078589" released by "delete_snapshot" :: held 5.845s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:22 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Created reservations ['77346523-5d77-48ea-b348-d163bcb3eef0', '4ff82715-55ed-4696-8b3b-bd6a6684e2dc', '173dfe01-10b0-4658-94fb-fa81a66a4a37', 'bb713371-9748-42ae-91dd-41e1dca5ae60'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:23 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea Jul 07 15:21:23 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Delete snapshot completed successfully. Jul 07 15:21:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b8409d01-5fd2-42b1-a75b-519677633b87 tempest-TestStampPattern-1153125313 None] Lock "cinder-db9d66cb-5703-4d87-a6ad-8ce638a8fbc0-delete_snapshot" released by "delete_snapshot" :: held 6.058s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:23 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea" returned: 0 in 1.037s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:23 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:21:23 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Converted 1024.00 MB image at 175.13 MB/s Jul 07 15:21:23 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a is being set with open permissions: ugo+rw Jul 07 15:21:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:23 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a Jul 07 15:21:23 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:24 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" returned: 0 in 0.761s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" released by "_copy_volume_from_snapshot" :: held 9.791s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Acquiring lock "cinder-quobyte-47aab1a3-c353-4830-b557-c5c342cb6c91" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-47aab1a3-c353-4830-b557-c5c342cb6c91" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Deleting offline snapshot 47aab1a3-c353-4830-b557-c5c342cb6c91 of volume d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] snapshot_file for this snap is: volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cce0264-b066-4079-8d16-ea0e14225267]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:24 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 Jul 07 15:21:24 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:25 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91" returned: 0 in 0.886s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d424fa5f-6022-40ab-8181-1919a971e0ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:21:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7452a060-66c5-4ae2-8c0f-3da81e403d94]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:25 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea Jul 07 15:21:25 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:26 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea" returned: 0 in 1.009s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:26 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 Jul 07 15:21:26 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:27 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:27 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91 Jul 07 15:21:27 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:28 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea.47aab1a3-c353-4830-b557-c5c342cb6c91" returned: 0 in 0.743s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-47aab1a3-c353-4830-b557-c5c342cb6c91" released by "_delete_snapshot" :: held 3.588s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.119s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb83c5d-62d2-4536-8984-be655a827ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a', 'volume_size': 2, 'source_volid': 'd424fa5f-6022-40ab-8181-1919a971e0ea', 'source_volstatus': 'available'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fb67a5-579a-48f8-8d80-e575d5fa7334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:28 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Volume volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a (eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a): created successfully Jul 07 15:21:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fb67a5-579a-48f8-8d80-e575d5fa7334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Flow 'volume_create_manager' (92acdef6-18db-4489-ad11-13d6c2eddc6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a0ae6c91-62ba-4a70-911d-c10f38657ba6 tempest-VolumesCloneTest-474504405 None] Created volume successfully. Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Acquiring lock "cinder-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Lock "cinder-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Acquiring lock "cinder-quobyte-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[779b17d0-c6bd-4462-be10-838ac14d443b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:29 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a Jul 07 15:21:29 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:29 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" returned: 0 in 0.795s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:29 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a Jul 07 15:21:29 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:30 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" returned: 0 in 0.669s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a" released by "delete_volume" :: held 1.525s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Created reservations ['01cb2c6e-9161-4aed-a98f-5c407186ed82', '7bd18abf-3367-4493-b390-2d171b9e6a54', 'e57a0bc6-47ad-4194-8572-f1a47e9603c6', '6e56670d-a150-499e-bed9-0f15123bf074'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:30 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:30 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Acquiring lock "cinder-d424fa5f-6022-40ab-8181-1919a971e0ea-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Lock "cinder-d424fa5f-6022-40ab-8181-1919a971e0ea-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Acquiring lock "cinder-quobyte-d424fa5f-6022-40ab-8181-1919a971e0ea" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-d424fa5f-6022-40ab-8181-1919a971e0ea" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4b2911-4fc1-41a3-add0-adcbc36a6346]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:31 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.841s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Deleted volume successfully. Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-cd02df2f-b59a-4934-a86c-286164078589-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5c09e39a-d46a-47f3-8775-5f1c180bf144 tempest-VolumesCloneTest-474504405 None] Lock "cinder-eec9c9fc-68e8-45c5-846f-c9c3c3a80b1a-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Lock "cinder-cd02df2f-b59a-4934-a86c-286164078589-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:31 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea Jul 07 15:21:31 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Acquiring lock "cinder-quobyte-cd02df2f-b59a-4934-a86c-286164078589" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-cd02df2f-b59a-4934-a86c-286164078589" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc143262-700b-470a-a03d-dbc2e18c87d5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:31 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:21:31 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:32 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea" returned: 0 in 1.099s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:32 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea Jul 07 15:21:32 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:32 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 0.962s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:32 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589 Jul 07 15:21:32 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:33 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d424fa5f-6022-40ab-8181-1919a971e0ea" returned: 0 in 0.785s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Lock "cinder-quobyte-d424fa5f-6022-40ab-8181-1919a971e0ea" released by "delete_volume" :: held 1.983s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Created reservations ['d7727bcc-dad3-45f2-9d64-d7929522e3ec', '650f67dc-0254-4a94-80cf-d42f7f134216', '94242059-2638-4f3b-a412-a57cd515ef4a', 'ca90c522-404b-48c7-baf5-e60db36caf5a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:33 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-cd02df2f-b59a-4934-a86c-286164078589" returned: 0 in 0.829s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Lock "cinder-quobyte-cd02df2f-b59a-4934-a86c-286164078589" released by "delete_volume" :: held 1.871s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Created reservations ['058aba3a-1a93-4cf7-8410-b7b4c18f7b8b', 'fbe62c37-1566-4f74-b856-20191c213aa6', '5e04ce72-d8d6-4d8f-a5ff-7fb55e06cbae', '5099adbf-802f-443d-8e9f-12bd98f56f81'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:33 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:33 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:33 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:33 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:34 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.827s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:34 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Deleted volume successfully. Jul 07 15:21:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-222e56cc-1a18-4177-986e-6b704b44faf1 tempest-VolumesCloneTest-474504405 None] Lock "cinder-d424fa5f-6022-40ab-8181-1919a971e0ea-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:34 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.085s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:34 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Deleted volume successfully. Jul 07 15:21:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-265a1227-5e77-4004-b01a-4cf7314ea90d tempest-TestStampPattern-1153125313 None] Lock "cinder-cd02df2f-b59a-4934-a86c-286164078589-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (b26d51e5-8765-4888-8267-02ce629b6c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b7ed3b-b15f-477a-8f75-2ca38eb0cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b7ed3b-b15f-477a-8f75-2ca38eb0cae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1594315200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d537871b-b9da-499e-b115-317e1e168c11,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:39Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a6bc13-0c12-416d-926e-1c6e8f2b1aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a6bc13-0c12-416d-926e-1c6e8f2b1aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff3f6e4-bdb5-4ea4-850a-eb0ce8b72559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff3f6e4-bdb5-4ea4-850a-eb0ce8b72559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd537871b-b9da-499e-b115-317e1e168c11', 'volume_name': 'volume-d537871b-b9da-499e-b115-317e1e168c11', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c6c6a4-85eb-4f87-81ec-66c1c3c9b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c6c6a4-85eb-4f87-81ec-66c1c3c9b59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cc55f4-be10-4f8b-8253-3ba9fb269b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Volume d537871b-b9da-499e-b115-317e1e168c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d537871b-b9da-499e-b115-317e1e168c11', 'volume_size': 1} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1594315200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d537871b-b9da-499e-b115-317e1e168c11,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:39Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Creating volume d537871b-b9da-499e-b115-317e1e168c11 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:39 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:39 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 1073741824 Jul 07 15:21:39 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:40 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 1073741824" returned: 0 in 0.988s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:40 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 Jul 07 15:21:40 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Flow 'volume_create_manager' (468d729e-c311-418f-bf0e-d657adeec504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191ff2b-4ae7-4e99-a40e-07d25e397253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191ff2b-4ae7-4e99-a40e-07d25e397253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1490829098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5755c-46e8-432d-9859-8bc1bf846d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb070b6661f459a9359679e7713fbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:40Z,use_quota=True,user_id='f3c5bbbb651542d4b8565665ea871ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0889cf5c-56fa-4d22-be42-4167d5972cb3),volume_type_id=0889cf5c-56fa-4d22-be42-4167d5972cb3)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa518152-520b-471c-91ab-d540c8d15f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa518152-520b-471c-91ab-d540c8d15f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118ed10f-6b55-4935-bdb6-94d9c9ebe9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118ed10f-6b55-4935-bdb6-94d9c9ebe9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c5755c-46e8-432d-9859-8bc1bf846d42', 'volume_name': 'volume-40c5755c-46e8-432d-9859-8bc1bf846d42', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ed8f13-6ec3-4c4c-813f-5c76f24663e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ed8f13-6ec3-4c4c-813f-5c76f24663e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca330271-d5bb-4993-9942-b2412fe2bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:40 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Volume 40c5755c-46e8-432d-9859-8bc1bf846d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c5755c-46e8-432d-9859-8bc1bf846d42', 'volume_size': 1} Jul 07 15:21:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:41 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11" returned: 0 in 0.910s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1490829098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5755c-46e8-432d-9859-8bc1bf846d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb070b6661f459a9359679e7713fbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:40Z,use_quota=True,user_id='f3c5bbbb651542d4b8565665ea871ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0889cf5c-56fa-4d22-be42-4167d5972cb3),volume_type_id=0889cf5c-56fa-4d22-be42-4167d5972cb3)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Creating volume 40c5755c-46e8-432d-9859-8bc1bf846d42 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:41 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cc55f4-be10-4f8b-8253-3ba9fb269b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d537871b-b9da-499e-b115-317e1e168c11', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 1073741824 Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4239aa78-6c80-43d7-b047-327dde06a9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Flow 'volume_create_manager' (0c1ac12a-d7c6-462f-9da6-f7cab00f762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c903919a-35ec-4e98-bd61-2e8c853d2dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Volume volume-d537871b-b9da-499e-b115-317e1e168c11 (d537871b-b9da-499e-b115-317e1e168c11): created successfully Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4239aa78-6c80-43d7-b047-327dde06a9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (b26d51e5-8765-4888-8267-02ce629b6c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c903919a-35ec-4e98-bd61-2e8c853d2dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-424617757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb070b6661f459a9359679e7713fbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:41Z,use_quota=True,user_id='f3c5bbbb651542d4b8565665ea871ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fb4957c-1ce6-4106-b904-afc7571dd332),volume_type_id=3fb4957c-1ce6-4106-b904-afc7571dd332)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279c28ad-f512-4e66-b6a0-97f329c5af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279c28ad-f512-4e66-b6a0-97f329c5af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5964e586-f15c-4e94-b2c3-dafa5f8c2415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5964e586-f15c-4e94-b2c3-dafa5f8c2415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13', 'volume_name': 'volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212359a9-06cf-4b80-9bb9-87a668f92074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212359a9-06cf-4b80-9bb9-87a668f92074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7780cd63-2796-4e26-9ae6-a81d1a218c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Volume b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13', 'volume_size': 1} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1b325899-1686-459c-8ca6-b8523817df29 tempest-VolumesGetTest-323659128 None] Created volume successfully. Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Flow 'volume_create_manager' (74a6b70d-9f0a-449d-9e5d-df73129b4d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fef8bce-d1ca-4a56-a299-a21fe3bc95df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fef8bce-d1ca-4a56-a299-a21fe3bc95df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1382086463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8462e51e-30fe-4e93-875e-cf0c07f0feee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb070b6661f459a9359679e7713fbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:42Z,use_quota=True,user_id='f3c5bbbb651542d4b8565665ea871ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c1a24e4-253e-4b24-a5c5-ba54019055e0),volume_type_id=4c1a24e4-253e-4b24-a5c5-ba54019055e0)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f81fdb8-84f0-432a-814b-7feba2ef81c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f81fdb8-84f0-432a-814b-7feba2ef81c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add335ad-ad0a-4854-8684-850e8dea4eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:41 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:21:42 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 1073741824" returned: 0 in 1.002s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:42 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 Jul 07 15:21:42 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add335ad-ad0a-4854-8684-850e8dea4eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8462e51e-30fe-4e93-875e-cf0c07f0feee', 'volume_name': 'volume-8462e51e-30fe-4e93-875e-cf0c07f0feee', 'volume_size': 1, 'image_id': '9b17542a-2522-428f-8de0-560b67ff05c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b17542a-2522-428f-8de0-560b67ff05c7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--536515734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb070b6661f459a9359679e7713fbb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b17542a-2522-428f-8de0-560b67ff05c7', 'created_at': datetime.datetime(2026, 7, 7, 13, 21, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b17542a-2522-428f-8de0-560b67ff05c7/file', 'properties': {}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c711b92-90e2-4ba3-8c1c-0f0f356cc725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c711b92-90e2-4ba3-8c1c-0f0f356cc725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac484555-580b-4e6f-bf71-1d21deb1e225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:42 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Volume 8462e51e-30fe-4e93-875e-cf0c07f0feee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8462e51e-30fe-4e93-875e-cf0c07f0feee', 'volume_size': 1, 'image_id': '9b17542a-2522-428f-8de0-560b67ff05c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b17542a-2522-428f-8de0-560b67ff05c7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--536515734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb070b6661f459a9359679e7713fbb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b17542a-2522-428f-8de0-560b67ff05c7', 'created_at': datetime.datetime(2026, 7, 7, 13, 21, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b17542a-2522-428f-8de0-560b67ff05c7/file', 'properties': {}}, 'image_service': } Jul 07 15:21:42 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Trying to clone 8462e51e-30fe-4e93-875e-cf0c07f0feee from image 9b17542a-2522-428f-8de0-560b67ff05c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b17542a-2522-428f-8de0-560b67ff05c7', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:21:43 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42" returned: 0 in 0.852s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.748s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-424617757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb070b6661f459a9359679e7713fbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:41Z,use_quota=True,user_id='f3c5bbbb651542d4b8565665ea871ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fb4957c-1ce6-4106-b904-afc7571dd332),volume_type_id=3fb4957c-1ce6-4106-b904-afc7571dd332)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Creating volume b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:43 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 1073741824 Jul 07 15:21:43 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca330271-d5bb-4993-9942-b2412fe2bc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c5755c-46e8-432d-9859-8bc1bf846d42', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98059cf-e129-4950-963e-336cd492e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Volume volume-40c5755c-46e8-432d-9859-8bc1bf846d42 (40c5755c-46e8-432d-9859-8bc1bf846d42): created successfully Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98059cf-e129-4950-963e-336cd492e340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Flow 'volume_create_manager' (468d729e-c311-418f-bf0e-d657adeec504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7e3999de-bc59-4c6e-9008-7a55f7060fc2 tempest-TestInstancesWithCinderVolumes-451656333 None] Created volume successfully. Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (e712974f-88e6-4c63-b52c-89ad1d04c114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2c6f78-1b4c-421b-b246-d725f337e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2c6f78-1b4c-421b-b246-d725f337e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2054188371',display_name='tempest-VolumesGetTest-Volume-872795011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856f2aa5-ad6f-4d4e-8f28-80cc196fe501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:43Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0b2da6-fa8d-412f-b649-abf04ef44748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0b2da6-fa8d-412f-b649-abf04ef44748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf8afd2-6b3f-447a-946e-79e2457a6fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf8afd2-6b3f-447a-946e-79e2457a6fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '856f2aa5-ad6f-4d4e-8f28-80cc196fe501', 'volume_name': 'volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d778cca2-5995-40e3-a0d7-d7cf99a9b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d778cca2-5995-40e3-a0d7-d7cf99a9b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cb4df9-c549-4897-8559-1d82fc14ca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Volume 856f2aa5-ad6f-4d4e-8f28-80cc196fe501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501', 'volume_size': 1} Jul 07 15:21:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:44 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 1073741824" returned: 0 in 1.009s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:44 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 Jul 07 15:21:44 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:44 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13" returned: 0 in 0.779s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.553s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2054188371',display_name='tempest-VolumesGetTest-Volume-872795011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856f2aa5-ad6f-4d4e-8f28-80cc196fe501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:43Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Creating volume 856f2aa5-ad6f-4d4e-8f28-80cc196fe501 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:44 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:44 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 1073741824 Jul 07 15:21:44 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7780cd63-2796-4e26-9ae6-a81d1a218c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed0896d-0f01-4b31-b23a-aea7d976953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Volume volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 (b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13): created successfully Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed0896d-0f01-4b31-b23a-aea7d976953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Flow 'volume_create_manager' (0c1ac12a-d7c6-462f-9da6-f7cab00f762e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-818cf3f6-3816-46e0-a83d-1160848e89bd tempest-TestInstancesWithCinderVolumes-451656333 None] Created volume successfully. Jul 07 15:21:45 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 1073741824" returned: 0 in 0.970s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:45 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 Jul 07 15:21:45 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD, size 20.69 MB, duration 4.24 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:21:46 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Image download 20.69 MB at 4.88 MB/s Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cd764c-7ce5-49f8-94e7-33e12520ffc2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:46 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501" returned: 0 in 0.750s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cb4df9-c549-4897-8559-1d82fc14ca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3085cf85-e19d-4097-8882-538c3aafae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Volume volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 (856f2aa5-ad6f-4d4e-8f28-80cc196fe501): created successfully Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3085cf85-e19d-4097-8882-538c3aafae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (e712974f-88e6-4c63-b52c-89ad1d04c114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-620bbe32-497f-4470-8900-0779244b104e tempest-VolumesGetTest-323659128 None] Created volume successfully. Jul 07 15:21:46 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD Jul 07 15:21:46 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:47 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Temporary image 9b17542a-2522-428f-8de0-560b67ff05c7 is fetched for user f3c5bbbb651542d4b8565665ea871ff5. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a551cbb-26b4-4f68-92c3-e0ab531a6477]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-856f2aa5-ad6f-4d4e-8f28-80cc196fe501-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:47 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD Jul 07 15:21:47 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Lock "cinder-856f2aa5-ad6f-4d4e-8f28-80cc196fe501-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-856f2aa5-ad6f-4d4e-8f28-80cc196fe501" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-856f2aa5-ad6f-4d4e-8f28-80cc196fe501" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971ded5-f43a-41d7-96b9-bb0646284ab2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:47 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 Jul 07 15:21:47 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:48 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1382086463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8462e51e-30fe-4e93-875e-cf0c07f0feee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb070b6661f459a9359679e7713fbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:42Z,use_quota=True,user_id='f3c5bbbb651542d4b8565665ea871ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c1a24e4-253e-4b24-a5c5-ba54019055e0),volume_type_id=4c1a24e4-253e-4b24-a5c5-ba54019055e0)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Creating volume 8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:48 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:48 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee 1073741824 Jul 07 15:21:48 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:48 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501" returned: 0 in 0.838s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:48 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501 Jul 07 15:21:48 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:49 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee 1073741824" returned: 0 in 0.907s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:49 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-856f2aa5-ad6f-4d4e-8f28-80cc196fe501" returned: 0 in 0.733s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-856f2aa5-ad6f-4d4e-8f28-80cc196fe501" released by "delete_volume" :: held 1.613s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:49 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:21:49 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Created reservations ['415a2214-c522-43b0-8abe-0c4df1e314ff', 'b34f997b-f78a-4918-aec0-34ce12db775c', '22343856-9534-41f3-97e2-ef89a528988d', '2c215505-f08d-48e3-b6ae-052caebdc05c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:49 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:49 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-d537871b-b9da-499e-b115-317e1e168c11-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Lock "cinder-d537871b-b9da-499e-b115-317e1e168c11-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-d537871b-b9da-499e-b115-317e1e168c11" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-d537871b-b9da-499e-b115-317e1e168c11" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:21:50 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 0 in 0.773s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d386781-7b62-4106-9e28-0d47aabc557f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Attempting download of 9b17542a-2522-428f-8de0-560b67ff05c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b17542a-2522-428f-8de0-560b67ff05c7', 'metadata': {}}])) to volume 8462e51e-30fe-4e93-875e-cf0c07f0feee. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:21:50 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 Jul 07 15:21:50 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc6d63-73b2-4c97-b877-f836b5b3581d]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b17542a-2522-428f-8de0-560b67ff05c7_zg3o1rwm {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:50 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.822s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Deleted volume successfully. Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-78d39e28-7c40-461b-b838-3b8bccccf3b5 tempest-VolumesGetTest-323659128 None] Lock "cinder-856f2aa5-ad6f-4d4e-8f28-80cc196fe501-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:50 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b17542a-2522-428f-8de0-560b67ff05c7_zg3o1rwm Jul 07 15:21:50 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:50 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11" returned: 0 in 0.894s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:51 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11 Jul 07 15:21:51 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:51 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b17542a-2522-428f-8de0-560b67ff05c7_zg3o1rwm" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b17542a-2522-428f-8de0-560b67ff05c7_zg3o1rwm {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:51 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b17542a-2522-428f-8de0-560b67ff05c7_zg3o1rwm Jul 07 15:21:51 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:51 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d537871b-b9da-499e-b115-317e1e168c11" returned: 0 in 0.767s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-d537871b-b9da-499e-b115-317e1e168c11" released by "delete_volume" :: held 1.728s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Created reservations ['a11c8494-9c03-4083-b61e-2934debc729b', '7da9a742-dddb-493e-b3d3-c0adab5518d5', '62614d24-df14-468c-bfd6-736f7a6d7c0c', '9432efb5-de39-425d-a0b5-e40d645081b2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:21:51 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b17542a-2522-428f-8de0-560b67ff05c7_zg3o1rwm" returned: 1 in 0.794s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b17542a-2522-428f-8de0-560b67ff05c7_zg3o1rwm' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e49530-330c-49fb-a423-ed57ae3c64bb]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:51 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:21:51 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:51 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD Jul 07 15:21:51 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:52 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] 9b17542a-2522-428f-8de0-560b67ff05c7 was qcow2, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:52 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.766s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:21:52 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Deleted volume successfully. Jul 07 15:21:52 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:21:52 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-8b5f5eb4-ff38-484e-8482-059c7672276f tempest-VolumesGetTest-323659128 None] Lock "cinder-d537871b-b9da-499e-b115-317e1e168c11-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (c8fba2cc-228f-4b28-b57c-a2dc11f3f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c4d554-72de-41bd-9bea-d6940899a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c4d554-72de-41bd-9bea-d6940899a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-862859336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6106eb65-7022-4e88-bfa4-2e02ce233bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:53Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927864e4-188c-4443-8280-4f478a90d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927864e4-188c-4443-8280-4f478a90d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6fcc81-b7e8-4f38-afd8-b0ddb9910f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6fcc81-b7e8-4f38-afd8-b0ddb9910f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6106eb65-7022-4e88-bfa4-2e02ce233bc1', 'volume_name': 'volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf9933e-7022-4976-8e83-9aa8245dc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf9933e-7022-4976-8e83-9aa8245dc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997fb5a5-5796-4c82-b197-d6bf4d4bc0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:53 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Volume 6106eb65-7022-4e88-bfa4-2e02ce233bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1', 'volume_size': 1} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-862859336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6106eb65-7022-4e88-bfa4-2e02ce233bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:53Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Creating volume 6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:21:53 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:21:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:53 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 1073741824 Jul 07 15:21:53 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:54 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 1073741824" returned: 0 in 1.032s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:54 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 Jul 07 15:21:54 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:54 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 0 in 2.007s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b17542a-2522-428f-8de0-560b67ff05c7_hooqkl3tdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:21:54 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Converted 112.00 MB image at 55.76 MB/s Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:54 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee 1G Jul 07 15:21:54 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:54 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1" returned: 0 in 0.689s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997fb5a5-5796-4c82-b197-d6bf4d4bc0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd6a031-342d-43bc-bdb3-a001509057c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:54 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Volume volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 (6106eb65-7022-4e88-bfa4-2e02ce233bc1): created successfully Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd6a031-342d-43bc-bdb3-a001509057c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (c8fba2cc-228f-4b28-b57c-a2dc11f3f17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c0df1101-9123-4350-ae73-c2688cf99632 tempest-VolumesGetTest-323659128 None] Created volume successfully. Jul 07 15:21:55 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee 1G" returned: 0 in 0.809s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a16c8-6f5c-42a9-bdbb-e32ea5f746da]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (23acd7ac-497b-4ba8-958b-ac0e04e79549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a50e0b-aedf-4f2d-a8f1-0406acaabb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:55 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:21:55 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a50e0b-aedf-4f2d-a8f1-0406acaabb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1405851313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffab08f-e9d6-435a-a072-f668375d333b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6106eb65-7022-4e88-bfa4-2e02ce233bc1,status='creating',terminated_at=None,updated_at=2026-07-07T13:21:56Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a31a04-9e4f-4201-af41-a451bfa872cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a31a04-9e4f-4201-af41-a451bfa872cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fc3b40-1b78-41a6-a284-2c420c2e21eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fc3b40-1b78-41a6-a284-2c420c2e21eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0ffab08f-e9d6-435a-a072-f668375d333b', 'volume_name': 'volume-0ffab08f-e9d6-435a-a072-f668375d333b', 'volume_size': 1, 'source_volid': '6106eb65-7022-4e88-bfa4-2e02ce233bc1', 'source_volstatus': 'available'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a1c913-3dfe-48a4-82e3-e996d6c9d11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a1c913-3dfe-48a4-82e3-e996d6c9d11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1435687b-ca18-43f5-ae56-39d8f6659171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:55 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Volume 0ffab08f-e9d6-435a-a072-f668375d333b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0ffab08f-e9d6-435a-a072-f668375d333b', 'volume_size': 1, 'source_volid': '6106eb65-7022-4e88-bfa4-2e02ce233bc1', 'source_volstatus': 'available'} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:21:55 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Cloning volume 6106eb65-7022-4e88-bfa4-2e02ce233bc1 to volume 0ffab08f-e9d6-435a-a072-f668375d333b Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Creating offline snapshot 3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 of volume 6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef29663-7ad2-4112-a929-bdb132b88604]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:21:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:55 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 Jul 07 15:21:55 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:56 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 0 in 0.877s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:56 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:21:56 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:56 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1" returned: 0 in 0.802s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:56 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 1G Jul 07 15:21:56 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:57 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 1 in 0.861s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Downloaded image 9b17542a-2522-428f-8de0-560b67ff05c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b17542a-2522-428f-8de0-560b67ff05c7', 'metadata': {}}])) to volume 8462e51e-30fe-4e93-875e-cf0c07f0feee successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Temporary image 9b17542a-2522-428f-8de0-560b67ff05c7 for user f3c5bbbb651542d4b8565665ea871ff5 is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Marking volume 8462e51e-30fe-4e93-875e-cf0c07f0feee as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Copying metadata from image 9b17542a-2522-428f-8de0-560b67ff05c7 to 8462e51e-30fe-4e93-875e-cf0c07f0feee. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Creating volume glance metadata for volume 8462e51e-30fe-4e93-875e-cf0c07f0feee backed by image 9b17542a-2522-428f-8de0-560b67ff05c7 with: {'image_id': '9b17542a-2522-428f-8de0-560b67ff05c7', 'image_name': 'tempest-scenario-img--536515734', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac484555-580b-4e6f-bf71-1d21deb1e225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8462e51e-30fe-4e93-875e-cf0c07f0feee', 'volume_size': 1, 'image_id': '9b17542a-2522-428f-8de0-560b67ff05c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b17542a-2522-428f-8de0-560b67ff05c7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--536515734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb070b6661f459a9359679e7713fbb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b17542a-2522-428f-8de0-560b67ff05c7', 'created_at': datetime.datetime(2026, 7, 7, 13, 21, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b17542a-2522-428f-8de0-560b67ff05c7/file', 'properties': {}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28c14d-de74-4953-a268-31830c5aee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:21:57 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Volume volume-8462e51e-30fe-4e93-875e-cf0c07f0feee (8462e51e-30fe-4e93-875e-cf0c07f0feee): created successfully Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28c14d-de74-4953-a268-31830c5aee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Flow 'volume_create_manager' (74a6b70d-9f0a-449d-9e5d-df73129b4d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:21:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c13317b1-9f2b-4d89-b5ca-18288c2df5eb tempest-TestInstancesWithCinderVolumes-451656333 None] Created volume successfully. Jul 07 15:21:57 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 1G" returned: 0 in 0.880s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:57 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 Jul 07 15:21:57 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:58 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" returned: 0 in 0.759s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:58 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 is being set with open permissions: ugo+rw Jul 07 15:21:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:58 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 Jul 07 15:21:58 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:59 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 07 15:21:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" returned: 0 in 0.688s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:21:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:21:59 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.info Jul 07 15:21:59 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:21:59 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.info" returned: 0 in 0.958s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:00 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.info is being set with open permissions: ugo+rw Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:00 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.info Jul 07 15:22:00 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:00 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:00 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:00 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.info" returned: 0 in 0.754s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-0ffab08f-e9d6-435a-a072-f668375d333b" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-0ffab08f-e9d6-435a-a072-f668375d333b" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] snapshot: 3fac5d7a-0ae0-4424-8f1e-bf757873a4d5, volume: 0ffab08f-e9d6-435a-a072-f668375d333b, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:22:00 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.792s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 28 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e37c38d-3243-4b28-8a16-25a7caa2c948]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:01 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 Jul 07 15:22:01 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:01 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" returned: 0 in 0.816s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:22:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:22:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:22:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4538f509-2012-4627-98d0-9b37848f700d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:01 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 Jul 07 15:22:01 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:02 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1" returned: 0 in 0.779s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:02 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:22:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:02 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b Jul 07 15:22:02 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:05 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=91,cinder:INSERT=32,cinder:UPDATE=113,cinder:DELETE=13 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:22:05 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=83,cinder:UPDATE=116,cinder:INSERT=34,cinder:DELETE=5 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:22:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:08 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b" returned: 0 in 6.237s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1d4e2-faa3-4832-baa1-a1b74ec0b695]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:08 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 Jul 07 15:22:08 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:09 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1" returned: 0 in 1.077s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:09 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:22:09 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Converted 1024.00 MB image at 164.15 MB/s Jul 07 15:22:09 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b is being set with open permissions: ugo+rw Jul 07 15:22:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:09 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b Jul 07 15:22:09 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:10 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b" returned: 0 in 0.702s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-0ffab08f-e9d6-435a-a072-f668375d333b" released by "_copy_volume_from_snapshot" :: held 9.728s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Deleting offline snapshot 3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 of volume 6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] snapshot_file for this snap is: volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8dfc0c-469b-48ac-9e1e-1ba266f56fed]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:10 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 Jul 07 15:22:10 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:11 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" returned: 0 in 0.823s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:22:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c51f34-edb6-4e14-a026-9bf5188eb41e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:11 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 Jul 07 15:22:11 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:12 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1" returned: 0 in 0.795s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:12 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 Jul 07 15:22:12 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:13 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" returned: 0 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:13 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5 Jul 07 15:22:13 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:13 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1.3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" returned: 0 in 0.784s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-3fac5d7a-0ae0-4424-8f1e-bf757873a4d5" released by "_delete_snapshot" :: held 3.285s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.097s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.927s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1435687b-ca18-43f5-ae56-39d8f6659171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffab08f-e9d6-435a-a072-f668375d333b', 'volume_size': 1, 'source_volid': '6106eb65-7022-4e88-bfa4-2e02ce233bc1', 'source_volstatus': 'available'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c8c2a7-4b27-4083-abaf-fccde519564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef96d09b-4f5f-446b-a341-e92d116f90b6]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Volume volume-0ffab08f-e9d6-435a-a072-f668375d333b (0ffab08f-e9d6-435a-a072-f668375d333b): created successfully Jul 07 15:22:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c8c2a7-4b27-4083-abaf-fccde519564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (23acd7ac-497b-4ba8-958b-ac0e04e79549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:14 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9656f88e-8603-4c93-9526-501ebdeb086e tempest-VolumesGetTest-323659128 None] Created volume successfully. Jul 07 15:22:14 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:22:14 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:14 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 0 in 0.907s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:15 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:22:15 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:15 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 1 in 0.908s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:22:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.880s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-8462e51e-30fe-4e93-875e-cf0c07f0feee', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1569a67f-5b74-43c6-8ec2-2889215d27e2', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:22:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-e18f1af7-e345-456f-abd1-d9cbccf2520a req-85bff476-d989-4522-840b-c0743efb6d3e tempest-TestInstancesWithCinderVolumes-451656333 None] attachment_update completed successfully. Jul 07 15:22:15 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:22:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (88c9c9a9-1df3-4367-b550-56ce640a035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df969f44-40d1-4237-ad24-136933ed757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df969f44-40d1-4237-ad24-136933ed757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1526667192',display_name='tempest-VolumesGetTest-Volume-125433576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d568ac92-cf90-4f85-909b-8d796b8481f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:16Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e176571e-6202-49fd-b14d-e078d77844a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e176571e-6202-49fd-b14d-e078d77844a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d08377-7300-4b4e-b213-dac20f5d1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d08377-7300-4b4e-b213-dac20f5d1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd568ac92-cf90-4f85-909b-8d796b8481f1', 'volume_name': 'volume-d568ac92-cf90-4f85-909b-8d796b8481f1', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4d8072-f7b6-4ccd-95e7-551cdb1c08c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4d8072-f7b6-4ccd-95e7-551cdb1c08c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5de09-e755-422d-9f07-d2de8cffa1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:16 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Volume d568ac92-cf90-4f85-909b-8d796b8481f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d568ac92-cf90-4f85-909b-8d796b8481f1', 'volume_size': 1} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1526667192',display_name='tempest-VolumesGetTest-Volume-125433576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d568ac92-cf90-4f85-909b-8d796b8481f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:16Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Creating volume d568ac92-cf90-4f85-909b-8d796b8481f1 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:22:16 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:22:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:16 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 1073741824 Jul 07 15:22:16 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:17 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 1073741824" returned: 0 in 0.947s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:17 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 Jul 07 15:22:17 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:17 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1" returned: 0 in 0.692s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5de09-e755-422d-9f07-d2de8cffa1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d568ac92-cf90-4f85-909b-8d796b8481f1', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76132bbc-1e7f-416e-a48b-11b39a50bbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:17 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Volume volume-d568ac92-cf90-4f85-909b-8d796b8481f1 (d568ac92-cf90-4f85-909b-8d796b8481f1): created successfully Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76132bbc-1e7f-416e-a48b-11b39a50bbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (88c9c9a9-1df3-4367-b550-56ce640a035e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:17 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f3d2bee8-79b3-493f-8fd3-66bb19d8cd23 tempest-VolumesGetTest-323659128 None] Created volume successfully. Jul 07 15:22:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-d568ac92-cf90-4f85-909b-8d796b8481f1-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Lock "cinder-d568ac92-cf90-4f85-909b-8d796b8481f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-d568ac92-cf90-4f85-909b-8d796b8481f1" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-d568ac92-cf90-4f85-909b-8d796b8481f1" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a60a7-ad2a-4eaa-99aa-9f3e450dc532]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:18 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 Jul 07 15:22:18 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:19 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1" returned: 0 in 0.792s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:19 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1 Jul 07 15:22:19 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:19 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d568ac92-cf90-4f85-909b-8d796b8481f1" returned: 0 in 0.831s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-d568ac92-cf90-4f85-909b-8d796b8481f1" released by "delete_volume" :: held 1.675s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Created reservations ['479c9a92-4b55-412a-82e3-92d931c74972', 'c2ecb617-95cd-490a-852a-7da7973d37f2', '4f63421b-8b71-4521-8e40-171c88552411', 'ad68ee64-d521-4a0c-83b2-3b9e938cd1ba'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:20 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:20 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-0ffab08f-e9d6-435a-a072-f668375d333b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Lock "cinder-0ffab08f-e9d6-435a-a072-f668375d333b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-0ffab08f-e9d6-435a-a072-f668375d333b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-0ffab08f-e9d6-435a-a072-f668375d333b" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c002e20d-1453-4ca5-8ea6-1e1a285e5580]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:20 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b Jul 07 15:22:20 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:20 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.839s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Deleted volume successfully. Jul 07 15:22:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b2f40728-b27c-4c46-8242-feeb997e9e61 tempest-VolumesGetTest-323659128 None] Lock "cinder-d568ac92-cf90-4f85-909b-8d796b8481f1-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:21 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b" returned: 0 in 1.082s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:21 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b Jul 07 15:22:21 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:22 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0ffab08f-e9d6-435a-a072-f668375d333b" returned: 0 in 0.725s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-0ffab08f-e9d6-435a-a072-f668375d333b" released by "delete_volume" :: held 1.859s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Created reservations ['f3ae05d0-4671-4f11-8366-a5845f11ec2a', '3e5cf5d3-3454-4b83-a8c7-ea15c799ab99', 'e8602ce5-6c3a-4bd0-aae0-e43b6c4cfddb', 'f5ca5443-a444-482f-a380-fff74650ae6e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Flow 'volume_create_manager' (73f5bfb8-c6fa-4102-9a31-fdc6c5596d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5933cba8-dd63-4387-8878-1f3859c53b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5933cba8-dd63-4387-8878-1f3859c53b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1425437896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe6f69e-30be-4026-a249-05f2063f1002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ad4a02474741d49e178c55a86a218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:23Z,use_quota=True,user_id='3310155c2eb54004ab959563fc18fbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891a3179-e2bc-4c0a-a927-a3de0ce83dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891a3179-e2bc-4c0a-a927-a3de0ce83dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ede304-aa5b-49c4-8d8f-3333a9ba829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ede304-aa5b-49c4-8d8f-3333a9ba829d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe6f69e-30be-4026-a249-05f2063f1002', 'volume_name': 'volume-dfe6f69e-30be-4026-a249-05f2063f1002', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd745207-d32b-4af1-b9a8-8d11abab5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd745207-d32b-4af1-b9a8-8d11abab5db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419c6ae4-2955-4329-8930-418293d6280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Volume dfe6f69e-30be-4026-a249-05f2063f1002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe6f69e-30be-4026-a249-05f2063f1002', 'volume_size': 1} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1425437896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe6f69e-30be-4026-a249-05f2063f1002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ad4a02474741d49e178c55a86a218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:23Z,use_quota=True,user_id='3310155c2eb54004ab959563fc18fbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Creating volume dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:22:22 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:22 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 1073741824 Jul 07 15:22:22 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:22 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:22 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-6106eb65-7022-4e88-bfa4-2e02ce233bc1-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Lock "cinder-6106eb65-7022-4e88-bfa4-2e02ce233bc1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-6106eb65-7022-4e88-bfa4-2e02ce233bc1" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-6106eb65-7022-4e88-bfa4-2e02ce233bc1" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b23aca-d724-4fe6-9c5b-b7912f2c1af5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:23 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 Jul 07 15:22:23 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:23 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.815s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Deleted volume successfully. Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2dd9837b-2881-4da4-899b-564489ca2ed4 tempest-VolumesGetTest-323659128 None] Lock "cinder-0ffab08f-e9d6-435a-a072-f668375d333b-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:23 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 1073741824" returned: 0 in 0.965s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:23 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 Jul 07 15:22:23 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:23 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1" returned: 0 in 0.792s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:23 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1 Jul 07 15:22:23 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:24 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002" returned: 0 in 0.662s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419c6ae4-2955-4329-8930-418293d6280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe6f69e-30be-4026-a249-05f2063f1002', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1e0dea-55a3-4aa2-a79d-8ab347cc067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Volume volume-dfe6f69e-30be-4026-a249-05f2063f1002 (dfe6f69e-30be-4026-a249-05f2063f1002): created successfully Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1e0dea-55a3-4aa2-a79d-8ab347cc067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Flow 'volume_create_manager' (73f5bfb8-c6fa-4102-9a31-fdc6c5596d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9a2385db-47d1-4c07-8329-438f7124c1b2 tempest-SnapshotDependencyTests-297136835 None] Created volume successfully. Jul 07 15:22:24 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6106eb65-7022-4e88-bfa4-2e02ce233bc1" returned: 0 in 0.642s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-6106eb65-7022-4e88-bfa4-2e02ce233bc1" released by "delete_volume" :: held 1.509s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Created reservations ['2dac7edc-c89c-45c8-8e30-a3804cc6f1c4', '86b3ea35-e275-47ba-86dc-0e987b8af349', 'e256b4d4-7a21-4864-a137-b689c77c863d', '7d7aa527-7bef-4f85-8003-4ce4c43b1025'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:24 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:24 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Creating offline snapshot 47d337e6-79ea-49ef-b34f-41cb11efe4da of volume dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b3acfe-3d61-4cf3-90cf-910dacbc36a2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:25 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 Jul 07 15:22:25 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:25 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.691s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:25 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Deleted volume successfully. Jul 07 15:22:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10c7d9ca-ae00-4d98-b26f-ddf07922c5bb tempest-VolumesGetTest-323659128 None] Lock "cinder-6106eb65-7022-4e88-bfa4-2e02ce233bc1-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:25 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002" returned: 0 in 0.835s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:25 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da 1G Jul 07 15:22:25 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (ed60ae60-37e6-42c4-bd18-ba0179f2d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a9115b-3618-45d5-9a7d-e160cc1f4e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a9115b-3618-45d5-9a7d-e160cc1f4e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2129716456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37983ad-ba0b-4607-a03b-935a529d05a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:26Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b8bb44-ec16-4bbc-b15b-593e5db30211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b8bb44-ec16-4bbc-b15b-593e5db30211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547b612e-4437-4f2e-a365-c34e336f1657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547b612e-4437-4f2e-a365-c34e336f1657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a37983ad-ba0b-4607-a03b-935a529d05a1', 'volume_name': 'volume-a37983ad-ba0b-4607-a03b-935a529d05a1', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7765de9-bbca-44b9-beb0-fc83262fb69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7765de9-bbca-44b9-beb0-fc83262fb69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eb2def-b47b-4f66-81d9-6bf25cbe174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:26 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Volume a37983ad-ba0b-4607-a03b-935a529d05a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a37983ad-ba0b-4607-a03b-935a529d05a1', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Trying to clone a37983ad-ba0b-4607-a03b-935a529d05a1 from image 7c780384-ba04-4889-abec-1e35c2057312 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:22:26 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Image download 20.69 MB at 20.69 MB/s Jul 07 15:22:26 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da 1G" returned: 0 in 0.947s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe6f69e-30be-4026-a249-05f2063f1002 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:26 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe6f69e-30be-4026-a249-05f2063f1002 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da Jul 07 15:22:26 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b93af3d-7c1f-499c-b4aa-97b50a3ba4ba]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:26 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD Jul 07 15:22:26 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:27 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe6f69e-30be-4026-a249-05f2063f1002 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da" returned: 0 in 0.849s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:27 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da is being set with open permissions: ugo+rw Jul 07 15:22:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:27 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da Jul 07 15:22:27 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:27 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD" returned: 0 in 1.106s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:27 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 is fetched for user 71be38f09aaa40c589852c9b8336c49e. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:22:28 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d631c1f-e9e2-479a-bfb3-ac2d80e488af]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:28 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD Jul 07 15:22:28 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:28 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da" returned: 0 in 1.163s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:28 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.info Jul 07 15:22:28 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:29 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD" returned: 0 in 0.963s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:29 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.info" returned: 0 in 0.794s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:29 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.info is being set with open permissions: ugo+rw Jul 07 15:22:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:29 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.info Jul 07 15:22:29 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:30 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.info" returned: 0 in 0.737s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.438s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.352s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2129716456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37983ad-ba0b-4607-a03b-935a529d05a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:26Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Creating volume a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:22:30 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:22:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:30 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 1073741824 Jul 07 15:22:30 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0bba5da0-d803-4896-ae44-03f7fa25e55c tempest-SnapshotDependencyTests-297136835 None] Create snapshot completed successfully Jul 07 15:22:31 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 1073741824" returned: 0 in 1.128s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:31 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 Jul 07 15:22:31 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Flow 'volume_create_manager' (6e98e87a-036f-483e-a8dd-6e41780ad975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb4cb6-7fc3-46b0-8ac7-e194e35857d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb4cb6-7fc3-46b0-8ac7-e194e35857d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ad4a02474741d49e178c55a86a218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47d337e6-79ea-49ef-b34f-41cb11efe4da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:32Z,use_quota=True,user_id='3310155c2eb54004ab959563fc18fbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e568bc0d-3abe-4fd2-9ffb-9e9523eca718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e568bc0d-3abe-4fd2-9ffb-9e9523eca718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ebc2c6-86d1-4a87-99b2-34698b7167ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ebc2c6-86d1-4a87-99b2-34698b7167ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e', 'volume_name': 'volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e', 'volume_size': 1, 'snapshot_id': '47d337e6-79ea-49ef-b34f-41cb11efe4da'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14f8033-a834-4336-a295-e3ff8621b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14f8033-a834-4336-a295-e3ff8621b80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19785327-44af-455c-80eb-0da3c02f9826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Volume 2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e', 'volume_size': 1, 'snapshot_id': '47d337e6-79ea-49ef-b34f-41cb11efe4da'} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:32 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1" returned: 0 in 0.910s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.154s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-quobyte-47d337e6-79ea-49ef-b34f-41cb11efe4da-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-47d337e6-79ea-49ef-b34f-41cb11efe4da-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Creating volume 2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e from snapshot 47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-quobyte-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Attempting download of 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume a37983ad-ba0b-4607-a03b-935a529d05a1. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] snapshot: 47d337e6-79ea-49ef-b34f-41cb11efe4da, volume: 2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe0e277-3dc8-45bc-8296-843ed6c3ee4d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f83ae-f2c4-4ccf-b9bb-efa79b84ef76]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_6yf3_wpy {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:32 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da Jul 07 15:22:32 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:32 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_6yf3_wpy Jul 07 15:22:32 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:33 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_6yf3_wpy" returned: 0 in 1.040s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_6yf3_wpy {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:33 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da" returned: 0 in 1.194s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe6f69e-30be-4026-a249-05f2063f1002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e8c838-4fa8-4661-a36b-aa57967d973c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:33 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_6yf3_wpy Jul 07 15:22:33 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:34 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 Jul 07 15:22:34 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:34 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_6yf3_wpy" returned: 1 in 1.065s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_6yf3_wpy' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:22:34 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe293c8-9122-48ba-bb2b-750798cf4f11]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:34 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD Jul 07 15:22:34 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:35 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002" returned: 0 in 1.215s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:35 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:22:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:35 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e Jul 07 15:22:35 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:35 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD" returned: 0 in 0.983s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:35 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] 7c780384-ba04-4889-abec-1e35c2057312 was qcow2, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:22:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:35 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 Jul 07 15:22:35 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:41 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1" returned: 0 in 5.533s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:41 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_jup9oh8_devstack@QuobyteHD, size 112.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:22:41 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Converted 112.00 MB image at 20.23 MB/s Jul 07 15:22:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:41 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 1G Jul 07 15:22:41 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:42 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" returned: 0 in 7.415s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=42,cinder:INSERT=9,cinder:DELETE=6,cinder:SELECT=29 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b63c82-8b1a-4850-869d-8bc2ff92fd39]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=37,cinder:SELECT=37,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:22:42 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 1G" returned: 0 in 1.297s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02ed207-93ab-4f0d-bfce-e0910f78628c]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:42 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 Jul 07 15:22:42 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:42 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 Jul 07 15:22:42 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:43 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1" returned: 0 in 0.757s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:43 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 Jul 07 15:22:43 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:43 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002" returned: 0 in 1.125s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:43 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:22:43 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Converted 1024.00 MB image at 138.05 MB/s Jul 07 15:22:43 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e is being set with open permissions: ugo+rw Jul 07 15:22:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:43 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e Jul 07 15:22:43 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:44 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1" returned: 1 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Downloaded image 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume a37983ad-ba0b-4607-a03b-935a529d05a1 successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 for user 71be38f09aaa40c589852c9b8336c49e is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Marking volume a37983ad-ba0b-4607-a03b-935a529d05a1 as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Copying metadata from image 7c780384-ba04-4889-abec-1e35c2057312 to a37983ad-ba0b-4607-a03b-935a529d05a1. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Creating volume glance metadata for volume a37983ad-ba0b-4607-a03b-935a529d05a1 backed by image 7c780384-ba04-4889-abec-1e35c2057312 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eb2def-b47b-4f66-81d9-6bf25cbe174b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37983ad-ba0b-4607-a03b-935a529d05a1', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55afa438-1f99-4c3a-9e90-16b672acc1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Volume volume-a37983ad-ba0b-4607-a03b-935a529d05a1 (a37983ad-ba0b-4607-a03b-935a529d05a1): created successfully Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55afa438-1f99-4c3a-9e90-16b672acc1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (ed60ae60-37e6-42c4-bd18-ba0179f2d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:44 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" returned: 0 in 0.687s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e29f48ef-0a7f-4566-9430-e172404fdc51 tempest-VolumesGetTest-323659128 None] Created volume successfully. Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" released by "_copy_volume_from_snapshot" :: held 11.786s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-47d337e6-79ea-49ef-b34f-41cb11efe4da-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" released by "_create_volume_from_snapshot" :: held 11.837s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.880s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19785327-44af-455c-80eb-0da3c02f9826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e', 'volume_size': 1, 'snapshot_id': '47d337e6-79ea-49ef-b34f-41cb11efe4da'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f43a93-3f7c-4c3b-8930-7f9e888bcfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Volume volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e (2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e): created successfully Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f43a93-3f7c-4c3b-8930-7f9e888bcfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Flow 'volume_create_manager' (6e98e87a-036f-483e-a8dd-6e41780ad975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-18cc08ab-7ec1-4409-b300-12eb48087e14 tempest-SnapshotDependencyTests-297136835 None] Created volume successfully. Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-47d337e6-79ea-49ef-b34f-41cb11efe4da-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-47d337e6-79ea-49ef-b34f-41cb11efe4da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-quobyte-dfe6f69e-30be-4026-a249-05f2063f1002" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-dfe6f69e-30be-4026-a249-05f2063f1002" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-quobyte-47d337e6-79ea-49ef-b34f-41cb11efe4da" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-47d337e6-79ea-49ef-b34f-41cb11efe4da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Deleting offline snapshot 47d337e6-79ea-49ef-b34f-41cb11efe4da of volume dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] snapshot_file for this snap is: volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce3b15-0765-484a-a7a8-0bd4041152e5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:45 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da Jul 07 15:22:45 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:45 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da" returned: 0 in 0.764s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe6f69e-30be-4026-a249-05f2063f1002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e4b42-fb10-4568-8fb6-03b6aa0cca59]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:45 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 Jul 07 15:22:45 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (6979979c-7e11-47f0-a9c1-5e6638e16beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2be706-0d0f-4ae2-a758-7013e7f4d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2be706-0d0f-4ae2-a758-7013e7f4d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371136550',display_name='tempest-VolumesGetTest-Volume-1718801619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b070b7-662b-4f4d-b70b-08e64f6b52b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:46Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7799ba3d-d488-4e5a-9714-4b152d9bd7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7799ba3d-d488-4e5a-9714-4b152d9bd7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc78755-8b3a-4d24-9edf-a1dc3d95d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc78755-8b3a-4d24-9edf-a1dc3d95d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b070b7-662b-4f4d-b70b-08e64f6b52b5', 'volume_name': 'volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c032311-967d-4164-92a7-6e5f0dc7d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c032311-967d-4164-92a7-6e5f0dc7d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b470070d-fd8b-4a85-a702-b7e7025b4a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Volume 84b070b7-662b-4f4d-b70b-08e64f6b52b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5', 'volume_size': 1} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:22:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371136550',display_name='tempest-VolumesGetTest-Volume-1718801619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b070b7-662b-4f4d-b70b-08e64f6b52b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a123c554f34a44b24c41ba433f6047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:22:46Z,use_quota=True,user_id='71be38f09aaa40c589852c9b8336c49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Creating volume 84b070b7-662b-4f4d-b70b-08e64f6b52b5 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:22:46 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:46 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 1073741824 Jul 07 15:22:46 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:46 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002" returned: 0 in 0.785s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:46 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da Jul 07 15:22:46 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:46 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 1073741824" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:46 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 Jul 07 15:22:46 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:47 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:47 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da Jul 07 15:22:47 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:47 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5" returned: 0 in 0.673s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b470070d-fd8b-4a85-a702-b7e7025b4a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ef6708-90a9-407c-8751-ee937c25f34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:22:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Volume volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 (84b070b7-662b-4f4d-b70b-08e64f6b52b5): created successfully Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ef6708-90a9-407c-8751-ee937c25f34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Flow 'volume_create_manager' (6979979c-7e11-47f0-a9c1-5e6638e16beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:22:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a20a3ead-da33-4214-950e-4dd7cfe7ca5c tempest-VolumesGetTest-323659128 None] Created volume successfully. Jul 07 15:22:47 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002.47d337e6-79ea-49ef-b34f-41cb11efe4da" returned: 0 in 0.668s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-47d337e6-79ea-49ef-b34f-41cb11efe4da" released by "_delete_snapshot" :: held 3.103s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-dfe6f69e-30be-4026-a249-05f2063f1002" released by "delete_snapshot" :: held 3.127s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Created reservations ['fb0988aa-52b6-4484-a99e-8b89ae856264', 'b7a08329-516c-4f33-9cc7-d2bacbaea076', 'cfe1ca63-b214-48bf-a66e-02f0c90b35f4', '844c385e-38d7-4177-8a67-0713ea0db4b4'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-84b070b7-662b-4f4d-b70b-08e64f6b52b5-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Lock "cinder-84b070b7-662b-4f4d-b70b-08e64f6b52b5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Delete snapshot completed successfully. Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-10206a87-5392-4a67-9d0f-9ddfe1c36bc5 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-47d337e6-79ea-49ef-b34f-41cb11efe4da-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-84b070b7-662b-4f4d-b70b-08e64f6b52b5" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-84b070b7-662b-4f4d-b70b-08e64f6b52b5" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[de092b75-26df-4f06-a4f5-617f5a014a39]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:48 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 Jul 07 15:22:48 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:49 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5" returned: 0 in 0.756s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:49 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5 Jul 07 15:22:49 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-dfe6f69e-30be-4026-a249-05f2063f1002-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-dfe6f69e-30be-4026-a249-05f2063f1002-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-quobyte-dfe6f69e-30be-4026-a249-05f2063f1002" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-dfe6f69e-30be-4026-a249-05f2063f1002" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2a3d64-f066-40a8-8621-00b686971cd6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:49 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 Jul 07 15:22:49 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:49 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-84b070b7-662b-4f4d-b70b-08e64f6b52b5" returned: 0 in 0.720s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-84b070b7-662b-4f4d-b70b-08e64f6b52b5" released by "delete_volume" :: held 1.532s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Created reservations ['76eb9e0d-c33b-460a-8415-eb948fe61d09', 'cbd208aa-6d67-4f36-af4e-e6e635ac63bf', '1c2f8507-4da3-40f1-b1d0-781da9aabfb4', 'e3f0599f-aa45-49d0-ab6d-b6145221c9e2'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:49 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:49 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:50 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:50 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002 Jul 07 15:22:50 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-a37983ad-ba0b-4607-a03b-935a529d05a1-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Lock "cinder-a37983ad-ba0b-4607-a03b-935a529d05a1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Acquiring lock "cinder-quobyte-a37983ad-ba0b-4607-a03b-935a529d05a1" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-a37983ad-ba0b-4607-a03b-935a529d05a1" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b896e46-a316-4d29-8f32-cb2df17d3382]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:50 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.797s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Deleted volume successfully. Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b595eb22-f702-472e-9d26-fe45925619a2 tempest-VolumesGetTest-323659128 None] Lock "cinder-84b070b7-662b-4f4d-b70b-08e64f6b52b5-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:50 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 Jul 07 15:22:50 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:50 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-dfe6f69e-30be-4026-a249-05f2063f1002" returned: 0 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-dfe6f69e-30be-4026-a249-05f2063f1002" released by "delete_volume" :: held 1.681s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Created reservations ['f7b87159-726d-4730-bf91-60dc9a1fee05', '8999f9ea-b5d6-4767-951d-0b46e1b5599c', '1f2aef01-6077-4af3-9401-229f4d55e035', 'd79954cc-1d12-4979-8f1a-083b0d9376f6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:51 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:51 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "cinder-quobyte-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" acquired by "delete_volume" :: waited 0.045s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:22:51 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1" returned: 0 in 0.945s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[27378630-026b-44db-9ecd-871668794a35]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:51 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e Jul 07 15:22:51 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:51 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 Jul 07 15:22:51 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:51 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.825s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Deleted volume successfully. Jul 07 15:22:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5b030584-96a9-427b-b7cf-e86d79f79110 tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-dfe6f69e-30be-4026-a249-05f2063f1002-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:52 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1" returned: 1 in 0.854s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:22:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:52 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1 Jul 07 15:22:52 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:52 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" returned: 0 in 0.874s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:52 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e Jul 07 15:22:52 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:53 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-a37983ad-ba0b-4607-a03b-935a529d05a1" returned: 0 in 0.689s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Lock "cinder-quobyte-a37983ad-ba0b-4607-a03b-935a529d05a1" released by "delete_volume" :: held 2.585s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:53 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-quobyte-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e" released by "delete_volume" :: held 1.627s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Created reservations ['4f30d587-d733-42a3-823b-a00c83367da2', 'ea43b81d-8fcb-43bf-8f36-6410b27995d9', '936043ed-7426-4103-92f8-4490f95f7075', 'f9df4577-6601-4ca1-bd2e-fd1462e6d517'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Created reservations ['62b7f7bc-40b9-48bb-8294-c7dc7e0a7678', 'cafcb305-6a38-4e01-8dca-687c76924d44', '09bf56a3-178a-4d85-be2a-81cbe98d79d2', '9178e64c-4928-4f68-83aa-26b5f62a3d32'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:53 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:53 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:53 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:22:53 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:54 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.694s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:54 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:54 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.745s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:54 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:22:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Deleted volume successfully. Jul 07 15:22:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Deleted volume successfully. Jul 07 15:22:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e4ea7754-2156-412c-9a61-e5ba73ceb6cf tempest-SnapshotDependencyTests-297136835 None] Lock "cinder-2a87884d-2a55-4fa9-8936-9b0f0d7e1e2e-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e480d26a-f4db-4ee1-9dea-da59a81c1406 tempest-VolumesGetTest-323659128 None] Lock "cinder-a37983ad-ba0b-4607-a03b-935a529d05a1-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:22:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-e828bf48-efda-48aa-8ba9-1e1a86cbb3a5 req-7208f064-c680-4be3-b2a8-cac34c6ffc7f tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:22:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-e828bf48-efda-48aa-8ba9-1e1a86cbb3a5 req-7208f064-c680-4be3-b2a8-cac34c6ffc7f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:22:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f06e372-b7a5-4c14-8f89-9ce143e27cdf]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:22:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-e828bf48-efda-48aa-8ba9-1e1a86cbb3a5 req-7208f064-c680-4be3-b2a8-cac34c6ffc7f tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:22:55 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 Jul 07 15:22:55 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:22:56 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 07 15:22:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-e828bf48-efda-48aa-8ba9-1e1a86cbb3a5 req-7208f064-c680-4be3-b2a8-cac34c6ffc7f tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42" returned: 0 in 0.895s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:22:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-e828bf48-efda-48aa-8ba9-1e1a86cbb3a5 req-7208f064-c680-4be3-b2a8-cac34c6ffc7f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:22:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-e828bf48-efda-48aa-8ba9-1e1a86cbb3a5 req-7208f064-c680-4be3-b2a8-cac34c6ffc7f tempest-TestInstancesWithCinderVolumes-451656333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-40c5755c-46e8-432d-9859-8bc1bf846d42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9195956-51c7-4e0c-b9b1-d4be31eb53a0', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:22:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-e828bf48-efda-48aa-8ba9-1e1a86cbb3a5 req-7208f064-c680-4be3-b2a8-cac34c6ffc7f tempest-TestInstancesWithCinderVolumes-451656333 None] attachment_update completed successfully. Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:00 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:23:00 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:00 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.881s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:23:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:23:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-85af7593-f02e-408d-8125-99b74e294ec1 req-217efd08-2d74-48f3-ae92-f9426feeba66 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-85af7593-f02e-408d-8125-99b74e294ec1 req-217efd08-2d74-48f3-ae92-f9426feeba66 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b6565-3903-4622-9535-b39a5abd4eb6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-85af7593-f02e-408d-8125-99b74e294ec1 req-217efd08-2d74-48f3-ae92-f9426feeba66 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:06 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 Jul 07 15:23:06 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:06 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=44,cinder:SELECT=41,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:23:06 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-85af7593-f02e-408d-8125-99b74e294ec1 req-217efd08-2d74-48f3-ae92-f9426feeba66 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13" returned: 0 in 0.805s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-85af7593-f02e-408d-8125-99b74e294ec1 req-217efd08-2d74-48f3-ae92-f9426feeba66 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:06 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-85af7593-f02e-408d-8125-99b74e294ec1 req-217efd08-2d74-48f3-ae92-f9426feeba66 tempest-TestInstancesWithCinderVolumes-451656333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d68206c-3325-4dbe-9bec-9dee1f151edd', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:23:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-85af7593-f02e-408d-8125-99b74e294ec1 req-217efd08-2d74-48f3-ae92-f9426feeba66 tempest-TestInstancesWithCinderVolumes-451656333 None] attachment_update completed successfully. Jul 07 15:23:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-ff5c2dd1-494d-4cd1-ac2d-7c8efd030213 req-db0cefd4-dcec-4234-a39a-65a5e10e2b45 tempest-TestInstancesWithCinderVolumes-451656333 None] Terminate volume connection completed successfully. Jul 07 15:23:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-ff5c2dd1-494d-4cd1-ac2d-7c8efd030213 req-db0cefd4-dcec-4234-a39a-65a5e10e2b45 tempest-TestInstancesWithCinderVolumes-451656333 None] Deleting attachment b9195956-51c7-4e0c-b9b1-d4be31eb53a0. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:23:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "cinder-40c5755c-46e8-432d-9859-8bc1bf846d42-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:23:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-40c5755c-46e8-432d-9859-8bc1bf846d42-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:23:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "cinder-quobyte-40c5755c-46e8-432d-9859-8bc1bf846d42" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:23:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-quobyte-40c5755c-46e8-432d-9859-8bc1bf846d42" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:23:17 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccdca30-9aad-41da-9e97-d1d4ca6ed4a4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:18 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 Jul 07 15:23:18 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:18 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42" returned: 0 in 0.913s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:18 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42 Jul 07 15:23:18 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:19 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-40c5755c-46e8-432d-9859-8bc1bf846d42" returned: 0 in 0.715s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-quobyte-40c5755c-46e8-432d-9859-8bc1bf846d42" released by "delete_volume" :: held 1.690s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:23:19 devstack cinder-volume[87257]: WARNING cinder.quota [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062390407-715038830 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062390407-715038830, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:23:19 devstack cinder-volume[87257]: WARNING cinder.quota [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062390407-715038830 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1062390407-715038830, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Created reservations ['0ea646df-1203-4861-8694-47a86a36badd', '8b35566a-45a8-4482-aa35-4a242c7c896f', '06b770bb-9578-4600-b46e-b01ab4482c66', 'c79eb9b1-d644-44ce-99d5-1b8a8783dbf9'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:19 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:23:19 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:20 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.680s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:23:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Deleted volume successfully. Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b00d9073-28a8-43bc-b3bb-739d26d20716 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-40c5755c-46e8-432d-9859-8bc1bf846d42-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Flow 'volume_create_manager' (130802b0-871b-4aee-ac8a-2d2970b91d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3736399-9102-4f80-8622-be53c6c0dd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3736399-9102-4f80-8622-be53c6c0dd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-827488448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb1def4-4b26-4161-a767-e7c34a189c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e06758c6ef40b2bdee20f77108dc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:23:21Z,use_quota=True,user_id='233694d7470648e29158969d4c50f089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06761dd0-94f8-4e12-b7a8-da9c6f164e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06761dd0-94f8-4e12-b7a8-da9c6f164e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d3fbce-a861-422f-b58c-653f4faaa224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:23:20 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d3fbce-a861-422f-b58c-653f4faaa224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cb1def4-4b26-4161-a767-e7c34a189c02', 'volume_name': 'volume-0cb1def4-4b26-4161-a767-e7c34a189c02', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d780ba-bcff-4dee-b513-7d151b5b7bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d780ba-bcff-4dee-b513-7d151b5b7bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef79a444-2166-4e34-98cd-368745cbeb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:23:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Volume 0cb1def4-4b26-4161-a767-e7c34a189c02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cb1def4-4b26-4161-a767-e7c34a189c02', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Trying to clone 0cb1def4-4b26-4161-a767-e7c34a189c02 from image 7c780384-ba04-4889-abec-1e35c2057312 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:23:21 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Image download 20.69 MB at 20.69 MB/s Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cc7423-1a99-4f28-a358-0d99ec9b6e98]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:21 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD Jul 07 15:23:21 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:22 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD" returned: 0 in 0.759s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:22 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 is fetched for user 233694d7470648e29158969d4c50f089. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:23:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[389cd90e-9d0f-40e9-8c99-ccef17439b2d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:22 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD Jul 07 15:23:22 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-2f15d0f3-4621-4112-a8aa-a2cc60183905 req-233b0a74-0b94-42d0-85ac-292f688cfe4a tempest-TestInstancesWithCinderVolumes-451656333 None] Terminate volume connection completed successfully. Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-2f15d0f3-4621-4112-a8aa-a2cc60183905 req-233b0a74-0b94-42d0-85ac-292f688cfe4a tempest-TestInstancesWithCinderVolumes-451656333 None] Deleting attachment 2d68206c-3325-4dbe-9bec-9dee1f151edd. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:23:23 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-827488448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb1def4-4b26-4161-a767-e7c34a189c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e06758c6ef40b2bdee20f77108dc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:23:21Z,use_quota=True,user_id='233694d7470648e29158969d4c50f089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Creating volume 0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:23:23 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:23 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 1073741824 Jul 07 15:23:23 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:23 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 1073741824" returned: 0 in 0.810s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:23 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:23:23 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:24 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 0 in 0.633s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Attempting download of 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume 0cb1def4-4b26-4161-a767-e7c34a189c02. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171d1e0-826a-4920-9e02-bdb39980ae77]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_ceao_aw6 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:24 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_ceao_aw6 Jul 07 15:23:24 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "cinder-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "cinder-quobyte-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-quobyte-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae523fd-e69c-4bae-ace8-4ce49dda4fc4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:25 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 Jul 07 15:23:25 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:25 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_ceao_aw6" returned: 0 in 0.815s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_ceao_aw6 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:25 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_ceao_aw6 Jul 07 15:23:25 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:25 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13" returned: 0 in 0.790s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:25 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13 Jul 07 15:23:25 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:26 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_ceao_aw6" returned: 1 in 0.792s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c780384-ba04-4889-abec-1e35c2057312_ceao_aw6' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[31705db3-4d5d-4eef-a34b-78adc7c347f2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:26 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD Jul 07 15:23:26 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:26 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13" returned: 0 in 0.729s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-quobyte-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13" released by "delete_volume" :: held 1.576s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:23:26 devstack cinder-volume[87257]: WARNING cinder.quota [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-302923436-740156436 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-302923436-740156436, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:23:26 devstack cinder-volume[87257]: WARNING cinder.quota [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-302923436-740156436 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-302923436-740156436, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Created reservations ['d2492f47-5dcd-4030-9112-0bf3b30a3ebf', 'e5f72c18-2489-44ca-9060-dc0d4c770c40', 'f00e7773-af9d-4c48-8c45-8e5926d9654a', 'ab337b66-7558-477e-94ed-c26a207ec6e6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:26 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:23:26 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:27 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD" returned: 0 in 0.848s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:27 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] 7c780384-ba04-4889-abec-1e35c2057312 was qcow2, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:23:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:27 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:23:27 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:27 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.784s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:27 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:23:27 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Deleted volume successfully. Jul 07 15:23:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c14cb1a-c6a3-44ea-b8d2-abcf3bd77f08 tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-b3dbaea4-6ca3-4d3d-b1ff-d8632e83ab13-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:23:29 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 0 in 1.951s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:29 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c780384-ba04-4889-abec-1e35c2057312_knykyi4idevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:23:29 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Converted 112.00 MB image at 57.39 MB/s Jul 07 15:23:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:29 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 1G Jul 07 15:23:29 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:29 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 1G" returned: 0 in 0.837s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:29 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d921fb-064b-4579-910b-ccd806c86d99]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:30 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:23:30 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:30 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:30 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:23:30 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-a0b908b6-efaf-4cf4-b42f-8f589b6a2e61 req-30a978ce-852a-4444-98e8-a550c8de2701 tempest-TestInstancesWithCinderVolumes-451656333 None] Terminate volume connection completed successfully. Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-a0b908b6-efaf-4cf4-b42f-8f589b6a2e61 req-30a978ce-852a-4444-98e8-a550c8de2701 tempest-TestInstancesWithCinderVolumes-451656333 None] Deleting attachment 1569a67f-5b74-43c6-8ec2-2889215d27e2. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:23:31 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 1 in 0.743s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Downloaded image 7c780384-ba04-4889-abec-1e35c2057312 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}])) to volume 0cb1def4-4b26-4161-a767-e7c34a189c02 successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Temporary image 7c780384-ba04-4889-abec-1e35c2057312 for user 233694d7470648e29158969d4c50f089 is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Marking volume 0cb1def4-4b26-4161-a767-e7c34a189c02 as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Copying metadata from image 7c780384-ba04-4889-abec-1e35c2057312 to 0cb1def4-4b26-4161-a767-e7c34a189c02. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Creating volume glance metadata for volume 0cb1def4-4b26-4161-a767-e7c34a189c02 backed by image 7c780384-ba04-4889-abec-1e35c2057312 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef79a444-2166-4e34-98cd-368745cbeb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb1def4-4b26-4161-a767-e7c34a189c02', 'volume_size': 1, 'image_id': '7c780384-ba04-4889-abec-1e35c2057312', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c780384-ba04-4889-abec-1e35c2057312', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c50816c25400419e8346ce74c3f416d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c780384-ba04-4889-abec-1e35c2057312', 'created_at': datetime.datetime(2026, 7, 7, 13, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 0, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c780384-ba04-4889-abec-1e35c2057312/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f5fc7d-f413-4424-a8fc-42f66b7a49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:23:31 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Volume volume-0cb1def4-4b26-4161-a767-e7c34a189c02 (0cb1def4-4b26-4161-a767-e7c34a189c02): created successfully Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f5fc7d-f413-4424-a8fc-42f66b7a49af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:23:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Flow 'volume_create_manager' (130802b0-871b-4aee-ac8a-2d2970b91d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:23:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f877afb1-f9bb-4a94-be24-6fd234af07eb tempest-TestShelveInstance-490064770 None] Created volume successfully. Jul 07 15:23:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "cinder-8462e51e-30fe-4e93-875e-cf0c07f0feee-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:23:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-8462e51e-30fe-4e93-875e-cf0c07f0feee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:23:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "cinder-quobyte-8462e51e-30fe-4e93-875e-cf0c07f0feee" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:23:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-quobyte-8462e51e-30fe-4e93-875e-cf0c07f0feee" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:23:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d16b6e-42e2-453f-9775-b84c371d1b39]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:35 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:23:35 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:36 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 0 in 0.746s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:36 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:23:36 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:36 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 1 in 0.752s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:23:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:36 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee Jul 07 15:23:36 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:37 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8462e51e-30fe-4e93-875e-cf0c07f0feee" returned: 0 in 0.641s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-quobyte-8462e51e-30fe-4e93-875e-cf0c07f0feee" released by "delete_volume" :: held 2.215s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:23:37 devstack cinder-volume[87257]: WARNING cinder.quota [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698889280-302371520 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698889280-302371520, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:23:37 devstack cinder-volume[87257]: WARNING cinder.quota [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698889280-302371520 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698889280-302371520, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Created reservations ['de17807f-943d-4a77-8664-06f4a2dac544', '85edc99f-aeaf-4fee-ba4e-febea1c0e29e', '9539eb5e-4d2a-4e3e-ab4b-016971f3785a', 'e552cf86-969e-4864-b3d5-d5bed52a865d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:37 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:23:37 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:38 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.638s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:38 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:23:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Deleted volume successfully. Jul 07 15:23:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-97215ab2-ddd3-494b-93c8-6e4eaaf8175f tempest-TestInstancesWithCinderVolumes-451656333 None] Lock "cinder-8462e51e-30fe-4e93-875e-cf0c07f0feee-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:23:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:23:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:23:39 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c7ace9-1caf-42d3-9f7c-f2dc383cc825]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:23:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:39 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:23:39 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:40 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 0 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:23:40 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:23:40 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:23:41 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 07 15:23:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 1 in 0.814s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:23:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:23:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.646s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:23:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-0cb1def4-4b26-4161-a767-e7c34a189c02', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81e905b9-04d5-4881-8595-2d728afa25a5', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:23:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-cbc07cf7-c4be-4276-9fbe-e39e5b8aa028 req-55d1abcb-b2f6-4e84-bb60-2acf35605afa tempest-TestShelveInstance-490064770 None] attachment_update completed successfully. Jul 07 15:23:51 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=41,cinder:UPDATE=29,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:23:51 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=76,cinder:INSERT=35,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:24:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:24:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:24:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:24:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:24:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:24:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:24:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:24:00 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:24:00 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:24:01 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 07 15:24:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.013s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:24:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:24:01 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:24:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:24:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:24:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-9988c4f4-f2b8-4ebe-8670-dd93a4344b69 req-c0ffa1df-5207-48d0-95ab-3fc039109059 tempest-TestShelveInstance-490064770 None] Terminate volume connection completed successfully. Jul 07 15:24:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-9988c4f4-f2b8-4ebe-8670-dd93a4344b69 req-c0ffa1df-5207-48d0-95ab-3fc039109059 tempest-TestShelveInstance-490064770 None] Deleting attachment 81e905b9-04d5-4881-8595-2d728afa25a5. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:24:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:24:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:24:23 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc978ca-bbdd-47bb-8ac8-1ebd54dd16a4]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:24:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:24:23 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:24:23 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:24:24 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jul 07 15:24:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 0 in 0.763s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:24:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:24:24 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:24:24 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:24:25 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 07 15:24:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 1 in 0.866s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:24:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:24:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.691s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:24:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-0cb1def4-4b26-4161-a767-e7c34a189c02', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ddb45c5-053b-4bad-a079-6ca01c6bcd14', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:24:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-87c6d7d7-b5b9-4ab3-af19-7ac4eda23046 req-936f1be0-3a98-4425-92e7-7cc230036e9a tempest-TestShelveInstance-490064770 None] attachment_update completed successfully. Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Flow 'volume_create_manager' (cd4f1992-352c-4e8d-90e2-7f54f118a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74105d7e-d1bb-4960-a33f-a575d1ca66ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74105d7e-d1bb-4960-a33f-a575d1ca66ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-809434723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eef59f-1fb5-401e-bda2-de0d247496f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9fadc764094015a6d32351917e4399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:24:27Z,use_quota=True,user_id='368e8db2929d46efb0167dadaecce92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19925835-f397-40d9-9afc-52f41b4851de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19925835-f397-40d9-9afc-52f41b4851de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb20f9d-d3f9-48e8-9172-17d73c8cb08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb20f9d-d3f9-48e8-9172-17d73c8cb08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eef59f-1fb5-401e-bda2-de0d247496f2', 'volume_name': 'volume-98eef59f-1fb5-401e-bda2-de0d247496f2', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea689e8-1e10-4dfa-bb16-7eb30cdc1ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea689e8-1e10-4dfa-bb16-7eb30cdc1ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969c19be-e5c9-4b7e-9e55-4e0c173ec1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:24:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Volume 98eef59f-1fb5-401e-bda2-de0d247496f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eef59f-1fb5-401e-bda2-de0d247496f2', 'volume_size': 1} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-809434723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eef59f-1fb5-401e-bda2-de0d247496f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9fadc764094015a6d32351917e4399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:24:27Z,use_quota=True,user_id='368e8db2929d46efb0167dadaecce92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Creating volume 98eef59f-1fb5-401e-bda2-de0d247496f2 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:24:27 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:24:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:24:27 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 1073741824 Jul 07 15:24:27 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:24:28 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 07 15:24:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 1073741824" returned: 0 in 0.841s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:24:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:24:28 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 Jul 07 15:24:28 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:24:29 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 07 15:24:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2" returned: 0 in 0.687s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:24:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:24:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:24:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969c19be-e5c9-4b7e-9e55-4e0c173ec1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eef59f-1fb5-401e-bda2-de0d247496f2', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:24:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268d886c-e26a-402b-9176-ddd048e4b344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:24:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Volume volume-98eef59f-1fb5-401e-bda2-de0d247496f2 (98eef59f-1fb5-401e-bda2-de0d247496f2): created successfully Jul 07 15:24:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268d886c-e26a-402b-9176-ddd048e4b344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:24:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Flow 'volume_create_manager' (cd4f1992-352c-4e8d-90e2-7f54f118a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:24:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c9e20303-4acb-4a22-b9d3-422532cb4388 tempest-TestMinimumBasicScenario-295319810 None] Created volume successfully. Jul 07 15:24:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-51efd2c1-4e68-43c4-968c-9a16afa8351e req-ba15b8c1-35dd-41b8-b599-7d6ebfda62f4 tempest-TestMinimumBasicScenario-295319810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:24:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-51efd2c1-4e68-43c4-968c-9a16afa8351e req-ba15b8c1-35dd-41b8-b599-7d6ebfda62f4 tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:24:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569bfae-b42d-4ac0-a8dc-ddf03e719ced]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:24:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-51efd2c1-4e68-43c4-968c-9a16afa8351e req-ba15b8c1-35dd-41b8-b599-7d6ebfda62f4 tempest-TestMinimumBasicScenario-295319810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:24:32 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 Jul 07 15:24:32 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:24:33 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 07 15:24:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-51efd2c1-4e68-43c4-968c-9a16afa8351e req-ba15b8c1-35dd-41b8-b599-7d6ebfda62f4 tempest-TestMinimumBasicScenario-295319810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2" returned: 0 in 0.877s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:24:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-51efd2c1-4e68-43c4-968c-9a16afa8351e req-ba15b8c1-35dd-41b8-b599-7d6ebfda62f4 tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:24:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-51efd2c1-4e68-43c4-968c-9a16afa8351e req-ba15b8c1-35dd-41b8-b599-7d6ebfda62f4 tempest-TestMinimumBasicScenario-295319810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf', 'name': 'volume-98eef59f-1fb5-401e-bda2-de0d247496f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3303aca2-c7ec-48c6-b776-ec325169c4c2', 'enforce_multipath': True} {{(pid=87257) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 15:24:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-51efd2c1-4e68-43c4-968c-9a16afa8351e req-ba15b8c1-35dd-41b8-b599-7d6ebfda62f4 tempest-TestMinimumBasicScenario-295319810 None] attachment_update completed successfully. Jul 07 15:24:43 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:24:43 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:00 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:25:00 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:00 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.726s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:25:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:25:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-c015f93d-3b18-4a49-af3c-fa2353901b92 tempest-TestShelveInstance-490064770 None] Terminate volume connection completed successfully. Jul 07 15:25:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-c015f93d-3b18-4a49-af3c-fa2353901b92 tempest-TestShelveInstance-490064770 None] Deleting attachment 4ddb45c5-053b-4bad-a079-6ca01c6bcd14. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:25:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Acquiring lock "cinder-0cb1def4-4b26-4161-a767-e7c34a189c02-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Lock "cinder-0cb1def4-4b26-4161-a767-e7c34a189c02-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Acquiring lock "cinder-quobyte-0cb1def4-4b26-4161-a767-e7c34a189c02" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Lock "cinder-quobyte-0cb1def4-4b26-4161-a767-e7c34a189c02" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:19 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e0eb4-f22d-435c-b330-6a6c910bddcd]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:19 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:25:19 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:20 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:20 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:25:20 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-33e72ac4-c2c8-4d5a-8e32-58783da06952 req-c2a4b48f-1c54-4b52-adec-cacb7ac5e44e tempest-TestMinimumBasicScenario-295319810 None] Terminate volume connection completed successfully. Jul 07 15:25:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [req-33e72ac4-c2c8-4d5a-8e32-58783da06952 req-c2a4b48f-1c54-4b52-adec-cacb7ac5e44e tempest-TestMinimumBasicScenario-295319810 None] Deleting attachment 3303aca2-c7ec-48c6-b776-ec325169c4c2. {{(pid=87257) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 15:25:21 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 1 in 0.784s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:21 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02 Jul 07 15:25:21 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:21 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0cb1def4-4b26-4161-a767-e7c34a189c02" returned: 0 in 0.663s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Lock "cinder-quobyte-0cb1def4-4b26-4161-a767-e7c34a189c02" released by "delete_volume" :: held 2.286s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG cinder.quota [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Created reservations ['c132aff4-448e-4594-9024-fb539ba53a93', '92c9f39f-816e-46cd-a749-6904b06c60bf', '0cc5ddfb-62b4-4bd3-9559-ae1bb91fee53', 'f4e55eda-eca1-4f57-bd7a-9e997fb6329e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:21 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:25:21 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:22 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.642s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG cinder.manager [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Acquiring lock "cinder-98eef59f-1fb5-401e-bda2-de0d247496f2-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:22 devstack cinder-volume[87257]: INFO cinder.volume.manager [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Deleted volume successfully. Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [req-c420425d-be3b-4168-b4d7-585bc11e2391 req-0828c68b-dd33-471f-8763-f10a165bde6a tempest-TestShelveInstance-490064770 None] Lock "cinder-0cb1def4-4b26-4161-a767-e7c34a189c02-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Lock "cinder-98eef59f-1fb5-401e-bda2-de0d247496f2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Acquiring lock "cinder-quobyte-98eef59f-1fb5-401e-bda2-de0d247496f2" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Lock "cinder-quobyte-98eef59f-1fb5-401e-bda2-de0d247496f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54cd5ed-5514-4d3c-a101-b09e255983c9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:22 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 Jul 07 15:25:22 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:23 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2" returned: 0 in 0.791s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:23 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2 Jul 07 15:25:23 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:24 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-98eef59f-1fb5-401e-bda2-de0d247496f2" returned: 0 in 0.642s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Lock "cinder-quobyte-98eef59f-1fb5-401e-bda2-de0d247496f2" released by "delete_volume" :: held 1.496s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Created reservations ['9c995691-e2a3-490b-ac6b-cfbf26263d7a', '738491f9-077e-4171-9b82-3d5703e159a7', '554cb86a-d09a-4b26-bb59-5c808e6445cf', '4a6cfae5-846b-4b0f-820c-f483960591f0'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:24 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:25:24 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:24 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.689s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:24 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:25:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Deleted volume successfully. Jul 07 15:25:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9c30186c-57b0-4d45-96fe-6daf5bffec1c tempest-TestMinimumBasicScenario-295319810 None] Lock "cinder-98eef59f-1fb5-401e-bda2-de0d247496f2-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (3ac43580-2107-4374-9466-73d106dccd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff92b75-3e37-416f-8e7c-89ca983fcda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff92b75-3e37-416f-8e7c-89ca983fcda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52722626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d96bb36-7530-4ad6-ad16-68e66a328f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:34Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6093bdd5-063e-4240-8aa6-66933b888f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6093bdd5-063e-4240-8aa6-66933b888f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd7842e-d9f9-4e0f-a30c-0da1b82af1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd7842e-d9f9-4e0f-a30c-0da1b82af1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d96bb36-7530-4ad6-ad16-68e66a328f34', 'volume_name': 'volume-1d96bb36-7530-4ad6-ad16-68e66a328f34', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c12efa6-71bb-4422-b569-2d84b9564f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c12efa6-71bb-4422-b569-2d84b9564f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb26ce15-c758-4c2d-bdb4-a97c61224281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:33 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume 1d96bb36-7530-4ad6-ad16-68e66a328f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d96bb36-7530-4ad6-ad16-68e66a328f34', 'volume_size': 1} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52722626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d96bb36-7530-4ad6-ad16-68e66a328f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:34Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Creating volume 1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:25:33 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:25:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:33 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 1073741824 Jul 07 15:25:33 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:34 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 1073741824" returned: 0 in 0.901s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:34 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 Jul 07 15:25:34 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:35 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34" returned: 0 in 0.674s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:25:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb26ce15-c758-4c2d-bdb4-a97c61224281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d96bb36-7530-4ad6-ad16-68e66a328f34', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d46f32c-5f86-4f9f-8ee9-f55ce5870cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:35 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 (1d96bb36-7530-4ad6-ad16-68e66a328f34): created successfully Jul 07 15:25:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d46f32c-5f86-4f9f-8ee9-f55ce5870cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (3ac43580-2107-4374-9466-73d106dccd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-46fb54f9-a19d-4e8a-8da6-b3e3912d9841 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created volume successfully. Jul 07 15:25:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Creating offline snapshot 180d04ec-6b41-486a-bfc0-fb0f7a4db9cc of volume 1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:25:36 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4674eba4-11cb-4071-9ca1-9d391ff21721]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:36 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 Jul 07 15:25:36 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:36 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34" returned: 0 in 0.762s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:36 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc 1G Jul 07 15:25:36 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:37 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc 1G" returned: 0 in 0.798s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:37 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc Jul 07 15:25:37 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:38 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" returned: 0 in 0.683s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:38 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc is being set with open permissions: ugo+rw Jul 07 15:25:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:38 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc Jul 07 15:25:38 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:38 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" returned: 0 in 0.713s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:39 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.info Jul 07 15:25:39 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:39 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.info" returned: 0 in 0.690s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:39 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.info is being set with open permissions: ugo+rw Jul 07 15:25:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:39 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.info Jul 07 15:25:39 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:40 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.info" returned: 0 in 0.660s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5ecd5da8-c515-4d05-a0a8-e870dce2fa5c tempest-CreateVolumesFromSnapshotTest-294476016 None] Create snapshot completed successfully Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (c73b20ff-ff9d-4d8e-b9e3-88a8b6b48d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783a5c2c-78fe-4646-9d57-3848f4cfc5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783a5c2c-78fe-4646-9d57-3848f4cfc5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408631511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce5b3ca-8b00-45ad-a9fc-45fbe97aa472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:42Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e0434f-31c9-4e92-969a-4ee96e5120f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e0434f-31c9-4e92-969a-4ee96e5120f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49556659-c692-4fc6-834b-0728d71fd4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49556659-c692-4fc6-834b-0728d71fd4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce5b3ca-8b00-45ad-a9fc-45fbe97aa472', 'volume_name': 'volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89f5889-637d-42fe-b65f-bf93bc8bbbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89f5889-637d-42fe-b65f-bf93bc8bbbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9ef715-1f98-4cd4-941c-48a07328630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:41 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume bce5b3ca-8b00-45ad-a9fc-45fbe97aa472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472', 'volume_size': 1} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408631511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce5b3ca-8b00-45ad-a9fc-45fbe97aa472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:42Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Creating volume bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:25:41 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:25:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:41 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 1073741824 Jul 07 15:25:41 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (87e81960-66d9-406b-b003-304135002f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd351b97-3580-4a8f-b94e-ffb3b0def36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd351b97-3580-4a8f-b94e-ffb3b0def36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1617421608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64129a1f-70b5-4974-bc31-0266aa773ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:42Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6fdf5a-df36-4d2e-a54f-d380847c84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6fdf5a-df36-4d2e-a54f-d380847c84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4962e0bd-7b18-4164-b6bb-1d24d7dc0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4962e0bd-7b18-4164-b6bb-1d24d7dc0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64129a1f-70b5-4974-bc31-0266aa773ab3', 'volume_name': 'volume-64129a1f-70b5-4974-bc31-0266aa773ab3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f9e694-7702-47fc-a71b-0967e5906c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f9e694-7702-47fc-a71b-0967e5906c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0acc4ec4-f69f-43d5-9227-3d112c81ebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume 64129a1f-70b5-4974-bc31-0266aa773ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64129a1f-70b5-4974-bc31-0266aa773ab3', 'volume_size': 1} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (49917e89-1cfa-4bfa-9c40-b1e8aa00f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9344b10-e93e-457a-891b-48944216c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9344b10-e93e-457a-891b-48944216c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586213624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa16bf9f-19a5-4f05-a593-827c3a3cffaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:42Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c73e36-2487-4245-9eed-123651afded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c73e36-2487-4245-9eed-123651afded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce342212-893d-454f-b740-b6d99cd1e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce342212-893d-454f-b740-b6d99cd1e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa16bf9f-19a5-4f05-a593-827c3a3cffaf', 'volume_name': 'volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a04f150-83ba-4d11-ad21-77ad68603db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a04f150-83ba-4d11-ad21-77ad68603db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15799b8e-bddd-4de9-8edf-e34cc9df2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume fa16bf9f-19a5-4f05-a593-827c3a3cffaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf', 'volume_size': 1} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:42 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 1073741824" returned: 0 in 1.080s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (5aeb18c8-f50a-40d8-ac58-f28f16fdcbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8489ca3c-b4cc-4565-b812-1368f293dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8489ca3c-b4cc-4565-b812-1368f293dde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726775980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ea1e9a-d265-40bc-9a28-a2052657c258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:43Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2a999d-d883-4f93-b13a-010f614ba36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2a999d-d883-4f93-b13a-010f614ba36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 Jul 07 15:25:43 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed478a67-3591-4f64-97d6-1ae1e73bd37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed478a67-3591-4f64-97d6-1ae1e73bd37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ea1e9a-d265-40bc-9a28-a2052657c258', 'volume_name': 'volume-d9ea1e9a-d265-40bc-9a28-a2052657c258', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4192bddf-10fd-4e13-9670-99e1aa81e4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4192bddf-10fd-4e13-9670-99e1aa81e4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b612ab9-d5db-4974-a598-c37a2afa9732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume d9ea1e9a-d265-40bc-9a28-a2052657c258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ea1e9a-d265-40bc-9a28-a2052657c258', 'volume_size': 1} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (73db73a6-6d9c-48a9-aa36-47927d2f4391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08490e35-84f9-4140-847f-19f6f8746476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08490e35-84f9-4140-847f-19f6f8746476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-873699471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caff763c-ff1b-4631-bb32-a820c704c0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:44Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4089979-c521-4c01-a664-324e46bb2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4089979-c521-4c01-a664-324e46bb2726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5190cdef-2aa8-453d-bcec-237c7d57b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5190cdef-2aa8-453d-bcec-237c7d57b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caff763c-ff1b-4631-bb32-a820c704c0b4', 'volume_name': 'volume-caff763c-ff1b-4631-bb32-a820c704c0b4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98c9773-4d44-44fd-a516-016ecc747431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98c9773-4d44-44fd-a516-016ecc747431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226b18b-03b2-460f-9bce-6ea2ebe7469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume caff763c-ff1b-4631-bb32-a820c704c0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caff763c-ff1b-4631-bb32-a820c704c0b4', 'volume_size': 1} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:43 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472" returned: 0 in 0.746s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.546s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1617421608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64129a1f-70b5-4974-bc31-0266aa773ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:42Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Creating volume 64129a1f-70b5-4974-bc31-0266aa773ab3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:25:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:43 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 1073741824 Jul 07 15:25:43 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9ef715-1f98-4cd4-941c-48a07328630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d4fe45-b3e1-406b-9eb1-081f34f24e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 (bce5b3ca-8b00-45ad-a9fc-45fbe97aa472): created successfully Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d4fe45-b3e1-406b-9eb1-081f34f24e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (c73b20ff-ff9d-4d8e-b9e3-88a8b6b48d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-35e51ee1-a752-4a09-a663-b0faa8040917 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created volume successfully. Jul 07 15:25:44 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 1073741824" returned: 0 in 0.862s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:44 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 Jul 07 15:25:44 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:45 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3" returned: 0 in 0.663s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586213624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa16bf9f-19a5-4f05-a593-827c3a3cffaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:42Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Creating volume fa16bf9f-19a5-4f05-a593-827c3a3cffaf {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:25:45 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0acc4ec4-f69f-43d5-9227-3d112c81ebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64129a1f-70b5-4974-bc31-0266aa773ab3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305d621c-9d51-4915-81b0-c15f30e4e5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:45 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf 1073741824 Jul 07 15:25:45 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:45 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume volume-64129a1f-70b5-4974-bc31-0266aa773ab3 (64129a1f-70b5-4974-bc31-0266aa773ab3): created successfully Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305d621c-9d51-4915-81b0-c15f30e4e5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (87e81960-66d9-406b-b003-304135002f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5767fd40-4314-4342-b525-b71db9651f10 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created volume successfully. Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Flow 'volume_create_manager' (98afa763-bdc4-4466-a94e-3e6c97b1b096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5f6358-453a-4ae1-9c00-0b1c78dcabd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5f6358-453a-4ae1-9c00-0b1c78dcabd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad345ab1-a7d3-4152-b982-101e78395c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1713253a1a4270b900dc97c602342b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:46Z,use_quota=True,user_id='3d0eeaac16ab4cb8990da454d9fd3651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197ffdee-72e0-4a7b-a3e0-c6e3d8c53214),volume_type_id=197ffdee-72e0-4a7b-a3e0-c6e3d8c53214)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603fa879-4779-46b6-a0cb-9d72f62e1724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603fa879-4779-46b6-a0cb-9d72f62e1724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8ba6b2-d2c4-4d67-becb-df5371fb5730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:25:46 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf 1073741824" returned: 0 in 0.869s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:46 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf Jul 07 15:25:46 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8ba6b2-d2c4-4d67-becb-df5371fb5730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad345ab1-a7d3-4152-b982-101e78395c4c', 'volume_name': 'volume-ad345ab1-a7d3-4152-b982-101e78395c4c', 'volume_size': 1, 'image_id': '892e394a-8b47-41b5-b1f6-7531eaf94c71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/892e394a-8b47-41b5-b1f6-7531eaf94c71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55d8a382e10d89cfca875eab906a9ace', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c1713253a1a4270b900dc97c602342b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec8c5e52f17cdd7d7f448782afe1c9c3fab33e9a57adba6913c25b0e8ebe1424bda2a374aed4cbd4c07a7abac429ddb601c252d1d17a457052018beeb4cef06e', 'id': '892e394a-8b47-41b5-b1f6-7531eaf94c71', 'created_at': datetime.datetime(2026, 7, 7, 13, 25, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 25, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/892e394a-8b47-41b5-b1f6-7531eaf94c71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4aafe3-8bd8-4d43-b447-536475b5e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4aafe3-8bd8-4d43-b447-536475b5e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32baacc2-98aa-41e0-af70-0b903b37f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Volume ad345ab1-a7d3-4152-b982-101e78395c4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad345ab1-a7d3-4152-b982-101e78395c4c', 'volume_size': 1, 'image_id': '892e394a-8b47-41b5-b1f6-7531eaf94c71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/892e394a-8b47-41b5-b1f6-7531eaf94c71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55d8a382e10d89cfca875eab906a9ace', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c1713253a1a4270b900dc97c602342b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec8c5e52f17cdd7d7f448782afe1c9c3fab33e9a57adba6913c25b0e8ebe1424bda2a374aed4cbd4c07a7abac429ddb601c252d1d17a457052018beeb4cef06e', 'id': '892e394a-8b47-41b5-b1f6-7531eaf94c71', 'created_at': datetime.datetime(2026, 7, 7, 13, 25, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 25, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/892e394a-8b47-41b5-b1f6-7531eaf94c71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Trying to clone ad345ab1-a7d3-4152-b982-101e78395c4c from image 892e394a-8b47-41b5-b1f6-7531eaf94c71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/892e394a-8b47-41b5-b1f6-7531eaf94c71', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:25:46 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Image download 0.00 MB at 0.00 MB/s Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[384f8407-6c5b-4518-8847-38c828af48a8]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:46 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD Jul 07 15:25:46 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:46 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf" returned: 0 in 0.725s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.912s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726775980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ea1e9a-d265-40bc-9a28-a2052657c258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:43Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Creating volume d9ea1e9a-d265-40bc-9a28-a2052657c258 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:25:46 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:25:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:46 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 1073741824 Jul 07 15:25:46 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15799b8e-bddd-4de9-8edf-e34cc9df2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7119c962-e37f-4fbf-89c8-9d7f0a62540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf (fa16bf9f-19a5-4f05-a593-827c3a3cffaf): created successfully Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7119c962-e37f-4fbf-89c8-9d7f0a62540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (49917e89-1cfa-4bfa-9c40-b1e8aa00f86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a143f1e6-a73c-47f0-a66d-d905e5976c24 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created volume successfully. Jul 07 15:25:47 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:47 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD Jul 07 15:25:47 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:47 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 1073741824" returned: 0 in 0.855s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:47 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD" returned: 1 in 0.752s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Temporary image 892e394a-8b47-41b5-b1f6-7531eaf94c71 is fetched for user 3d0eeaac16ab4cb8990da454d9fd3651. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:25:47 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 Jul 07 15:25:47 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[630275c7-7349-4eb3-bf20-b09bc5ea37a6]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:48 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD Jul 07 15:25:48 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:48 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258" returned: 0 in 0.702s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.927s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-873699471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caff763c-ff1b-4631-bb32-a820c704c0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050b9d687d4ee5a4ec47f942342e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:44Z,use_quota=True,user_id='50054fa5aca04e50913a03e87e41fbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Creating volume caff763c-ff1b-4631-bb32-a820c704c0b4 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:25:48 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b612ab9-d5db-4974-a598-c37a2afa9732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ea1e9a-d265-40bc-9a28-a2052657c258', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:48 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 1073741824 Jul 07 15:25:48 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145f59d5-aa42-43a0-8a78-de2610cd1cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:48 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 (d9ea1e9a-d265-40bc-9a28-a2052657c258): created successfully Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145f59d5-aa42-43a0-8a78-de2610cd1cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (5aeb18c8-f50a-40d8-ac58-f28f16fdcbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-305eaa02-53d1-4511-94ab-11c0e7e9bf68 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created volume successfully. Jul 07 15:25:48 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:48 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD Jul 07 15:25:48 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:49 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 1073741824" returned: 0 in 0.842s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:49 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 Jul 07 15:25:49 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:49 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD" returned: 1 in 0.769s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:25:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:50 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4" returned: 0 in 0.633s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad345ab1-a7d3-4152-b982-101e78395c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1713253a1a4270b900dc97c602342b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:25:46Z,use_quota=True,user_id='3d0eeaac16ab4cb8990da454d9fd3651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197ffdee-72e0-4a7b-a3e0-c6e3d8c53214),volume_type_id=197ffdee-72e0-4a7b-a3e0-c6e3d8c53214)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Creating volume ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:25:50 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:50 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c 1073741824 Jul 07 15:25:50 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226b18b-03b2-460f-9bce-6ea2ebe7469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caff763c-ff1b-4631-bb32-a820c704c0b4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c53c795-9208-48de-904d-2637b44cb5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Volume volume-caff763c-ff1b-4631-bb32-a820c704c0b4 (caff763c-ff1b-4631-bb32-a820c704c0b4): created successfully Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c53c795-9208-48de-904d-2637b44cb5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Flow 'volume_create_manager' (73db73a6-6d9c-48a9-aa36-47927d2f4391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4da1d195-3b55-4c43-8ab1-cf004e3d5843 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created volume successfully. Jul 07 15:25:50 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c 1073741824" returned: 0 in 0.797s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:50 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c Jul 07 15:25:50 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-caff763c-ff1b-4631-bb32-a820c704c0b4-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-caff763c-ff1b-4631-bb32-a820c704c0b4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-caff763c-ff1b-4631-bb32-a820c704c0b4" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-caff763c-ff1b-4631-bb32-a820c704c0b4" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[762435e4-3142-41c8-862c-fa89b945ce9c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:51 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 Jul 07 15:25:51 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:51 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c" returned: 0 in 0.666s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Attempting download of 892e394a-8b47-41b5-b1f6-7531eaf94c71 ((None, [{'url': 'file:///opt/stack/data/glance/images/892e394a-8b47-41b5-b1f6-7531eaf94c71', 'metadata': {}}])) to volume ad345ab1-a7d3-4152-b982-101e78395c4c. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0bbb3f-f120-4291-99c5-c2821b89178c]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_892e394a-8b47-41b5-b1f6-7531eaf94c71_riqq0cby {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:51 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_892e394a-8b47-41b5-b1f6-7531eaf94c71_riqq0cby Jul 07 15:25:51 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:52 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4" returned: 0 in 0.758s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:52 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4 Jul 07 15:25:52 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:52 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_892e394a-8b47-41b5-b1f6-7531eaf94c71_riqq0cby" returned: 0 in 0.726s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892e394a-8b47-41b5-b1f6-7531eaf94c71_riqq0cby {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:52 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892e394a-8b47-41b5-b1f6-7531eaf94c71_riqq0cby Jul 07 15:25:52 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:52 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-caff763c-ff1b-4631-bb32-a820c704c0b4" returned: 0 in 0.676s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-caff763c-ff1b-4631-bb32-a820c704c0b4" released by "delete_volume" :: held 1.480s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created reservations ['1d1c17fe-3baf-462a-9720-4337e64707f9', '1aa8b1b4-f874-4fab-9fab-63aa270a2e68', '6945f4a4-1a10-4568-a4e6-1da0e0808a49', 'c7e37115-4ac2-4994-ad35-9f01f35e6338'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:52 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:25:52 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:53 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892e394a-8b47-41b5-b1f6-7531eaf94c71_riqq0cby" returned: 1 in 0.760s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892e394a-8b47-41b5-b1f6-7531eaf94c71_riqq0cby' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ab0aa-d691-4768-85fd-214d895a784e]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:53 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD Jul 07 15:25:53 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-d9ea1e9a-d265-40bc-9a28-a2052657c258-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-d9ea1e9a-d265-40bc-9a28-a2052657c258-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-d9ea1e9a-d265-40bc-9a28-a2052657c258" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-d9ea1e9a-d265-40bc-9a28-a2052657c258" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a03737-a97a-49ed-9367-3bcdb5c39352]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:53 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.726s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:25:53 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Deleted volume successfully. Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8a17d0a-2938-4392-a71d-99b5f7156d47 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-caff763c-ff1b-4631-bb32-a820c704c0b4-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:53 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 Jul 07 15:25:53 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:53 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:54 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD Jul 07 15:25:54 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:54 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258" returned: 0 in 0.796s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:54 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258 Jul 07 15:25:54 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:54 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:25:54 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] 892e394a-8b47-41b5-b1f6-7531eaf94c71 was raw, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:25:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:54 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c Jul 07 15:25:54 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:55 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d9ea1e9a-d265-40bc-9a28-a2052657c258" returned: 0 in 0.676s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-d9ea1e9a-d265-40bc-9a28-a2052657c258" released by "delete_volume" :: held 1.510s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Created reservations ['10a9eb41-af71-462e-8c5a-53e816065469', '2ce1ce73-4caa-4999-8761-8af42fd835e9', 'b5f3a839-a225-4813-ae41-7e5ca15eec29', 'd80c77a0-8289-4dc8-9ac5-589830feacbd'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:55 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:25:55 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:55 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c" returned: 0 in 0.719s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_892e394a-8b47-41b5-b1f6-7531eaf94c71_ki9gsdxndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:25:55 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:55 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c 1G Jul 07 15:25:55 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-fa16bf9f-19a5-4f05-a593-827c3a3cffaf-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-fa16bf9f-19a5-4f05-a593-827c3a3cffaf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-fa16bf9f-19a5-4f05-a593-827c3a3cffaf" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-fa16bf9f-19a5-4f05-a593-827c3a3cffaf" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd9452-7fc5-4977-8e66-c66c9c10e3ca]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:55 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.671s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:25:55 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Deleted volume successfully. Jul 07 15:25:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f3ca1fe-03e3-4842-88ef-c9c05ca6a01e tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-d9ea1e9a-d265-40bc-9a28-a2052657c258-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:55 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf Jul 07 15:25:55 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:56 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c 1G" returned: 0 in 0.701s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2f8c25-7101-4f6f-af59-7ea7e1c9fd6a]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:56 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c Jul 07 15:25:56 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:56 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf" returned: 0 in 0.767s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:56 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf Jul 07 15:25:56 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:56 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c" returned: 0 in 0.756s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:57 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c Jul 07 15:25:57 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:57 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fa16bf9f-19a5-4f05-a593-827c3a3cffaf" returned: 0 in 0.642s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-fa16bf9f-19a5-4f05-a593-827c3a3cffaf" released by "delete_volume" :: held 1.462s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Created reservations ['4f190fca-76d0-4446-8058-bbe6433e738c', '97fbd5fc-1c5e-432b-b71c-e54462615a00', 'f22480e3-559d-4c1a-b05b-0b7d9259fd1f', '6a529cbd-4a1c-4f02-85d8-3e1a18c0e95c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:57 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:25:57 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:57 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c" returned: 1 in 0.765s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Downloaded image 892e394a-8b47-41b5-b1f6-7531eaf94c71 ((None, [{'url': 'file:///opt/stack/data/glance/images/892e394a-8b47-41b5-b1f6-7531eaf94c71', 'metadata': {}}])) to volume ad345ab1-a7d3-4152-b982-101e78395c4c successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Temporary image 892e394a-8b47-41b5-b1f6-7531eaf94c71 for user 3d0eeaac16ab4cb8990da454d9fd3651 is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Marking volume ad345ab1-a7d3-4152-b982-101e78395c4c as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Copying metadata from image 892e394a-8b47-41b5-b1f6-7531eaf94c71 to ad345ab1-a7d3-4152-b982-101e78395c4c. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Creating volume glance metadata for volume ad345ab1-a7d3-4152-b982-101e78395c4c backed by image 892e394a-8b47-41b5-b1f6-7531eaf94c71 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '892e394a-8b47-41b5-b1f6-7531eaf94c71', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '55d8a382e10d89cfca875eab906a9ace', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32baacc2-98aa-41e0-af70-0b903b37f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad345ab1-a7d3-4152-b982-101e78395c4c', 'volume_size': 1, 'image_id': '892e394a-8b47-41b5-b1f6-7531eaf94c71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/892e394a-8b47-41b5-b1f6-7531eaf94c71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55d8a382e10d89cfca875eab906a9ace', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c1713253a1a4270b900dc97c602342b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec8c5e52f17cdd7d7f448782afe1c9c3fab33e9a57adba6913c25b0e8ebe1424bda2a374aed4cbd4c07a7abac429ddb601c252d1d17a457052018beeb4cef06e', 'id': '892e394a-8b47-41b5-b1f6-7531eaf94c71', 'created_at': datetime.datetime(2026, 7, 7, 13, 25, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 25, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/892e394a-8b47-41b5-b1f6-7531eaf94c71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240e2916-b074-4a5c-9d81-3b735af9157f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:25:57 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Volume volume-ad345ab1-a7d3-4152-b982-101e78395c4c (ad345ab1-a7d3-4152-b982-101e78395c4c): created successfully Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240e2916-b074-4a5c-9d81-3b735af9157f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Flow 'volume_create_manager' (98afa763-bdc4-4466-a94e-3e6c97b1b096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:25:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-cc294330-f10e-4eb9-997d-e3c8d2dee266 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Created volume successfully. Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-64129a1f-70b5-4974-bc31-0266aa773ab3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-64129a1f-70b5-4974-bc31-0266aa773ab3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-64129a1f-70b5-4974-bc31-0266aa773ab3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-64129a1f-70b5-4974-bc31-0266aa773ab3" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[987f4495-16e9-421b-8739-e7c5982be28d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:58 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:25:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Deleted volume successfully. Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-61d016a7-f1f2-4e87-8fe5-0965b8477dab tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-fa16bf9f-19a5-4f05-a593-827c3a3cffaf-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:58 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 Jul 07 15:25:58 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Acquiring lock "cinder-ad345ab1-a7d3-4152-b982-101e78395c4c-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "cinder-ad345ab1-a7d3-4152-b982-101e78395c4c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Acquiring lock "cinder-quobyte-ad345ab1-a7d3-4152-b982-101e78395c4c" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3" returned: 0 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:58 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "cinder-quobyte-ad345ab1-a7d3-4152-b982-101e78395c4c" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:25:58 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3 Jul 07 15:25:58 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6a632-be04-48d2-8174-9d9238c85f56]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:25:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:58 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c Jul 07 15:25:58 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:59 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-64129a1f-70b5-4974-bc31-0266aa773ab3" returned: 0 in 0.650s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-64129a1f-70b5-4974-bc31-0266aa773ab3" released by "delete_volume" :: held 1.469s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created reservations ['fedb4a5c-16c5-4570-9567-fe02f3b2ca9b', '26ca7354-a460-4e69-b93e-6398a921fce4', '1551ca89-9cc8-4314-b588-394b40545323', '340c77df-60bd-441d-9286-e0fb7d08a2c5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:59 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:25:59 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:25:59 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c" returned: 0 in 0.756s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:25:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:25:59 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c Jul 07 15:25:59 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:00 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:00 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:00 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.714s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Deleted volume successfully. Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60a9ce-6604-4dbb-a762-da77aab19ae7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b7651363-bf6c-4da5-a7d3-c283f0444da8 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-64129a1f-70b5-4974-bc31-0266aa773ab3-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:00 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c" returned: 1 in 0.755s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:00 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c Jul 07 15:26:00 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:00 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 Jul 07 15:26:00 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:00 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.736s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:26:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:26:01 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ad345ab1-a7d3-4152-b982-101e78395c4c" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:01 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472" returned: 0 in 0.771s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "cinder-quobyte-ad345ab1-a7d3-4152-b982-101e78395c4c" released by "delete_volume" :: held 2.272s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:01 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472 Jul 07 15:26:01 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:01 devstack cinder-volume[87257]: WARNING cinder.quota [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:26:01 devstack cinder-volume[87257]: WARNING cinder.quota [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Created reservations ['d30c5002-d932-4458-a1aa-6ca075fc8913', 'dc1fa920-3d8f-43c7-bd8b-8e562d566463', '7d24c938-8d67-43a2-a0a8-850c85fd7d84', '8029fff5-a988-44ad-a62c-34664f38cb7c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:01 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:01 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:01 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472" returned: 0 in 0.670s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472" released by "delete_volume" :: held 1.497s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created reservations ['6a582872-06c1-48b8-96c6-65d84a7ef015', '44a07c68-d140-476a-b6cd-c205d0513777', '7c805e2f-b2e8-40e3-9b33-68c7b831412b', 'f1894b70-ae96-4047-a871-9ba3cd97e468'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:01 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.662s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Deleted volume successfully. Jul 07 15:26:01 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:01 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f2ad4345-75bf-4907-a2ed-dfb34880dc32 tempest-VolumeAndVolumeTypeFromImageTest-39838604 None] Lock "cinder-ad345ab1-a7d3-4152-b982-101e78395c4c-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-180d04ec-6b41-486a-bfc0-fb0f7a4db9cc-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-180d04ec-6b41-486a-bfc0-fb0f7a4db9cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-1d96bb36-7530-4ad6-ad16-68e66a328f34" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-1d96bb36-7530-4ad6-ad16-68e66a328f34" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Deleting offline snapshot 180d04ec-6b41-486a-bfc0-fb0f7a4db9cc of volume 1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] snapshot_file for this snap is: volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[09640e8b-d125-4873-b97b-d1d93c310e66]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:02 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.681s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:02 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Deleted volume successfully. Jul 07 15:26:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43b77ce0-fd8f-42e5-a2df-f0faa9886a77 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-bce5b3ca-8b00-45ad-a9fc-45fbe97aa472-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:02 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc Jul 07 15:26:02 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:03 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" returned: 0 in 0.804s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d96bb36-7530-4ad6-ad16-68e66a328f34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:26:03 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8803e6f-3e2c-48da-bbd7-314ba8f2ff34]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:03 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 Jul 07 15:26:03 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:04 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34" returned: 0 in 0.807s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:04 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc Jul 07 15:26:04 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:04 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" returned: 0 in 0.795s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:05 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc Jul 07 15:26:05 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:05 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34.180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" returned: 0 in 0.645s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-180d04ec-6b41-486a-bfc0-fb0f7a4db9cc" released by "_delete_snapshot" :: held 3.167s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-1d96bb36-7530-4ad6-ad16-68e66a328f34" released by "delete_snapshot" :: held 3.191s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:05 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Created reservations ['40f7b13d-6451-411d-b5a7-0b77d679d454', 'a0226f9d-d502-40fc-973d-54f2bf19b35e', '8eda9522-f45a-4049-9c61-bf7c12bc0f7e', 'b23207d7-e589-4ce9-a10f-27875aa7889e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Delete snapshot completed successfully. Jul 07 15:26:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aa76d7a3-8470-4380-8e43-9098b04bd531 tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-180d04ec-6b41-486a-bfc0-fb0f7a4db9cc-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-1d96bb36-7530-4ad6-ad16-68e66a328f34-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-1d96bb36-7530-4ad6-ad16-68e66a328f34-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "cinder-quobyte-1d96bb36-7530-4ad6-ad16-68e66a328f34" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-1d96bb36-7530-4ad6-ad16-68e66a328f34" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:06 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[394a6bd7-3491-46e8-b384-600f72d4a989]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:06 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 Jul 07 15:26:06 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:07 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34" returned: 0 in 0.770s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:07 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34 Jul 07 15:26:07 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:08 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1d96bb36-7530-4ad6-ad16-68e66a328f34" returned: 0 in 0.632s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-quobyte-1d96bb36-7530-4ad6-ad16-68e66a328f34" released by "delete_volume" :: held 1.470s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Created reservations ['fc5b7445-00db-4e4c-aec6-a10d74ad1e5a', '3a08f250-c7d1-4f52-a553-cebd7d05dbc5', 'e9ccc3b3-753d-49ce-a881-d5b6568e5b92', '5235a530-41c9-4446-8527-1af12b60fdcf'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:08 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:08 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Flow 'volume_create_manager' (671924c6-b730-4fea-8881-3038a32c4ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae21322-77af-4e4d-97d6-a3708dca4e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae21322-77af-4e4d-97d6-a3708dca4e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae8e852-df0a-485b-b713-0679f57629e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d7a6a7e0964e97826e37ebf751a021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:09Z,use_quota=True,user_id='423d694ec38f41d4bcd78f8776cdfcb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80b48a7-4667-4069-854f-8b70befb3c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80b48a7-4667-4069-854f-8b70befb3c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbb4606-b952-4e09-8887-b8fa0bd1cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbb4606-b952-4e09-8887-b8fa0bd1cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bae8e852-df0a-485b-b713-0679f57629e2', 'volume_name': 'volume-bae8e852-df0a-485b-b713-0679f57629e2', 'volume_size': 1, 'image_id': 'e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ceb28e03fcf8948ccc456fa213abd47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06d7a6a7e0964e97826e37ebf751a021', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c60903af53334600bde312a1ba3177cd9c5b08dd4122cfb7e6bd69ffb3c854aa89aba42253fbf1db7962f25378d3bbcce24e9467b7085c4e76552f1c3a8d6a9', 'id': 'e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'created_at': datetime.datetime(2026, 7, 7, 13, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a/file', 'properties': {}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c160a852-7c05-46cd-aff7-ddd0006baa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c160a852-7c05-46cd-aff7-ddd0006baa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b1d838-fbab-41fc-b352-98593f216606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:08 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Volume bae8e852-df0a-485b-b713-0679f57629e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bae8e852-df0a-485b-b713-0679f57629e2', 'volume_size': 1, 'image_id': 'e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ceb28e03fcf8948ccc456fa213abd47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06d7a6a7e0964e97826e37ebf751a021', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c60903af53334600bde312a1ba3177cd9c5b08dd4122cfb7e6bd69ffb3c854aa89aba42253fbf1db7962f25378d3bbcce24e9467b7085c4e76552f1c3a8d6a9', 'id': 'e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'created_at': datetime.datetime(2026, 7, 7, 13, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a/file', 'properties': {}}, 'image_service': } Jul 07 15:26:08 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Trying to clone bae8e852-df0a-485b-b713-0679f57629e2 from image e1a8e1ce-9974-4b21-bf42-7a5b97799f7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:26:09 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.662s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:09 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Deleted volume successfully. Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:26:09 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Image download 0.00 MB at 0.00 MB/s Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-15c62085-816d-4864-ad1a-5b6b9b70fa7c tempest-CreateVolumesFromSnapshotTest-294476016 None] Lock "cinder-1d96bb36-7530-4ad6-ad16-68e66a328f34-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8900c7cf-0a19-4236-904a-0eac7a4d135f]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:09 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD Jul 07 15:26:09 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:09 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:09 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD Jul 07 15:26:09 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:10 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD" returned: 1 in 0.717s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:26:10 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Temporary image e1a8e1ce-9974-4b21-bf42-7a5b97799f7a is fetched for user 423d694ec38f41d4bcd78f8776cdfcb1. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:26:10 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd24d0a6-4eac-49a6-b629-1dcd8fa1e3e3]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:10 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD Jul 07 15:26:10 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:11 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:11 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD Jul 07 15:26:11 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (8cb3adae-f7b1-42dc-9aa9-e6a1c6b1651f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83827285-653d-428b-ac3e-3caec17d6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83827285-653d-428b-ac3e-3caec17d6b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-398309625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87252214-a582-43e9-ab09-c1b4618a7636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:12Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446b3fad-70f2-4303-bea4-5becc5ba68e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446b3fad-70f2-4303-bea4-5becc5ba68e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7adf39-4c3a-4a5a-9691-d17334844e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7adf39-4c3a-4a5a-9691-d17334844e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87252214-a582-43e9-ab09-c1b4618a7636', 'volume_name': 'volume-87252214-a582-43e9-ab09-c1b4618a7636', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d964cf4d-ba54-41b4-9018-2ee347b969b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d964cf4d-ba54-41b4-9018-2ee347b969b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb191a9d-6d3e-4139-bb8d-c91d4244a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:11 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume 87252214-a582-43e9-ab09-c1b4618a7636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87252214-a582-43e9-ab09-c1b4618a7636', 'volume_size': 1} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-398309625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87252214-a582-43e9-ab09-c1b4618a7636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:12Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Creating volume 87252214-a582-43e9-ab09-c1b4618a7636 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:11 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:11 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 1073741824 Jul 07 15:26:11 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:12 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD" returned: 1 in 0.755s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:26:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:12 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 1073741824" returned: 0 in 0.823s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:12 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 Jul 07 15:26:12 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:13 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636" returned: 0 in 0.633s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae8e852-df0a-485b-b713-0679f57629e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d7a6a7e0964e97826e37ebf751a021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:09Z,use_quota=True,user_id='423d694ec38f41d4bcd78f8776cdfcb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Creating volume bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:13 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb191a9d-6d3e-4139-bb8d-c91d4244a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87252214-a582-43e9-ab09-c1b4618a7636', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:13 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 1073741824 Jul 07 15:26:13 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723ebc0f-2933-4038-816a-0f0dffa597fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:13 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume volume-87252214-a582-43e9-ab09-c1b4618a7636 (87252214-a582-43e9-ab09-c1b4618a7636): created successfully Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723ebc0f-2933-4038-816a-0f0dffa597fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:13 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (8cb3adae-f7b1-42dc-9aa9-e6a1c6b1651f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8bec9388-fe98-4f1e-b787-d806a19606a5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created volume successfully. Jul 07 15:26:14 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 1073741824" returned: 0 in 0.861s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=86,cinder:INSERT=30,cinder:UPDATE=96,cinder:DELETE=12 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=76,cinder:UPDATE=116,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:14 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 Jul 07 15:26:14 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (dcfc9ef2-5e57-459f-bc23-ba58ca91fcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8146e0e-94cd-4fce-8d96-f538e4769fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8146e0e-94cd-4fce-8d96-f538e4769fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1026587670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55047e4d-0b96-4f24-b659-43abc08922bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:14Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6b3030-5eee-420a-92c5-45dce26de883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6b3030-5eee-420a-92c5-45dce26de883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95031c-2fce-49b0-9e44-ff0e47a396da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95031c-2fce-49b0-9e44-ff0e47a396da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55047e4d-0b96-4f24-b659-43abc08922bf', 'volume_name': 'volume-55047e4d-0b96-4f24-b659-43abc08922bf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ba9b27-9f81-432c-84bf-196b376bde8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ba9b27-9f81-432c-84bf-196b376bde8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12141fe7-f4c1-4be5-a47a-852e162a203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume 55047e4d-0b96-4f24-b659-43abc08922bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55047e4d-0b96-4f24-b659-43abc08922bf', 'volume_size': 1} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (38335af8-47ad-4c34-ae8b-bcc3f6fc4dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f2af1c-55ba-49ba-b97a-e514a8ac9d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f2af1c-55ba-49ba-b97a-e514a8ac9d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2131188960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f008a69-084e-4d4a-8244-bdf1ad91e88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:15Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910d3ee8-563f-4616-90dc-39bcc751e4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910d3ee8-563f-4616-90dc-39bcc751e4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf9a61d-fcfe-4a0b-963e-a934937e081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf9a61d-fcfe-4a0b-963e-a934937e081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f008a69-084e-4d4a-8244-bdf1ad91e88f', 'volume_name': 'volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a1ec2d-37ab-4415-9f87-5e3c52e232ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a1ec2d-37ab-4415-9f87-5e3c52e232ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aca95c-02be-4a55-8b2e-f1844d9688e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:14 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume 2f008a69-084e-4d4a-8244-bdf1ad91e88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f', 'volume_size': 1} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:14 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2" returned: 0 in 0.724s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1026587670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55047e4d-0b96-4f24-b659-43abc08922bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:14Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Creating volume 55047e4d-0b96-4f24-b659-43abc08922bf {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:14 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:14 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf 1073741824 Jul 07 15:26:14 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (0686f24a-392b-43d2-9143-6afbac55e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31464c99-e2bc-4c7f-912d-0c7c1f5c7545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Attempting download of e1a8e1ce-9974-4b21-bf42-7a5b97799f7a ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'metadata': {}}])) to volume bae8e852-df0a-485b-b713-0679f57629e2. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31464c99-e2bc-4c7f-912d-0c7c1f5c7545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048343127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee09247-44ef-4ba3-87b9-fd85a7596fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:15Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c718e510-a180-4fe6-8364-9341c2826c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c718e510-a180-4fe6-8364-9341c2826c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea23282-053d-46c9-8516-dc1a9eb678f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea23282-053d-46c9-8516-dc1a9eb678f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee09247-44ef-4ba3-87b9-fd85a7596fa8', 'volume_name': 'volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fdf6d4-2fc8-4bc6-93b2-ee44529862da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fdf6d4-2fc8-4bc6-93b2-ee44529862da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f7af96-7c28-4674-8444-8335a4bd4132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume 8ee09247-44ef-4ba3-87b9-fd85a7596fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8', 'volume_size': 1} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9313e3f9-e4a9-4691-9853-d5d165fa1c7c]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_k0x_4b1q {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:15 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_k0x_4b1q Jul 07 15:26:15 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (70d5a4a8-d6b6-4f46-ae05-1451441e3b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279d345f-61ce-4138-bfcc-1e2106b1019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279d345f-61ce-4138-bfcc-1e2106b1019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586289304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6e09f4-7e51-4c2e-b74a-be0bb316cfab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:15Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15857da9-1bd8-40ab-806d-bce304945713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15857da9-1bd8-40ab-806d-bce304945713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71898881-f7d9-4ab5-af00-942ea7e03dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71898881-f7d9-4ab5-af00-942ea7e03dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6e09f4-7e51-4c2e-b74a-be0bb316cfab', 'volume_name': 'volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb743201-76a2-465d-8e30-5769c0de17fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb743201-76a2-465d-8e30-5769c0de17fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e872235-94c9-4f3a-a9d7-ccd68e5899ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume ce6e09f4-7e51-4c2e-b74a-be0bb316cfab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab', 'volume_size': 1} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (2aa8147d-ac9c-4664-b54b-34460a06309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c403efc-665f-4f10-a9dc-99b8d003bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c403efc-665f-4f10-a9dc-99b8d003bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151415336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e869aea-f549-4793-8bc9-8c5d2859a180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:16Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67db2b12-6ded-442a-99b3-59735500a6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67db2b12-6ded-442a-99b3-59735500a6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e08a0d-2dea-49a1-9fd5-fbe8b0b2bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e08a0d-2dea-49a1-9fd5-fbe8b0b2bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e869aea-f549-4793-8bc9-8c5d2859a180', 'volume_name': 'volume-9e869aea-f549-4793-8bc9-8c5d2859a180', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ba8daf-112a-44ec-873b-cbc065619e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ba8daf-112a-44ec-873b-cbc065619e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb97645-a84f-463d-9697-f4de736d2056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:15 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume 9e869aea-f549-4793-8bc9-8c5d2859a180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e869aea-f549-4793-8bc9-8c5d2859a180', 'volume_size': 1} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:15 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf 1073741824" returned: 0 in 0.986s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:15 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_k0x_4b1q" returned: 0 in 0.853s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_k0x_4b1q {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:16 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf Jul 07 15:26:16 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:16 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_k0x_4b1q Jul 07 15:26:16 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:16 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2131188960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f008a69-084e-4d4a-8244-bdf1ad91e88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:15Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Creating volume 2f008a69-084e-4d4a-8244-bdf1ad91e88f {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:16 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12141fe7-f4c1-4be5-a47a-852e162a203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55047e4d-0b96-4f24-b659-43abc08922bf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:16 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f 1073741824 Jul 07 15:26:16 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb07f0f-7ab9-4ac3-8a73-cda8668eb80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:16 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume volume-55047e4d-0b96-4f24-b659-43abc08922bf (55047e4d-0b96-4f24-b659-43abc08922bf): created successfully Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb07f0f-7ab9-4ac3-8a73-cda8668eb80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (dcfc9ef2-5e57-459f-bc23-ba58ca91fcae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:16 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fb70c192-0d21-42c5-a8db-ed13fa73b6a8 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created volume successfully. Jul 07 15:26:16 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_k0x_4b1q" returned: 1 in 0.760s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_k0x_4b1q' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a590c9d-5015-4ba6-a752-20c148a354b8]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:16 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD Jul 07 15:26:16 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:17 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f 1073741824" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:17 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD" returned: 0 in 0.745s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:17 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f Jul 07 15:26:17 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:17 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD Jul 07 15:26:17 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:18 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.080s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048343127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee09247-44ef-4ba3-87b9-fd85a7596fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:15Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Creating volume 8ee09247-44ef-4ba3-87b9-fd85a7596fa8 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:18 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:18 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:18 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 1073741824 Jul 07 15:26:18 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aca95c-02be-4a55-8b2e-f1844d9688e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65be17b0-5b12-48b7-9e14-206271e83604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD" returned: 1 in 0.748s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] e1a8e1ce-9974-4b21-bf42-7a5b97799f7a was raw, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:18 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f (2f008a69-084e-4d4a-8244-bdf1ad91e88f): created successfully Jul 07 15:26:18 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 Jul 07 15:26:18 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65be17b0-5b12-48b7-9e14-206271e83604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (38335af8-47ad-4c34-ae8b-bcc3f6fc4dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9b2438bd-fb3a-4f9e-a086-889fa7ca4ec3 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created volume successfully. Jul 07 15:26:19 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2" returned: 0 in 0.774s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1a8e1ce-9974-4b21-bf42-7a5b97799f7a_wyo_lxd7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:26:19 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:19 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 1073741824" returned: 0 in 0.853s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:19 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 1G Jul 07 15:26:19 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:19 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 Jul 07 15:26:19 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:19 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 1G" returned: 0 in 0.676s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:19 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8" returned: 0 in 0.656s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[95793d5d-9901-4621-81c1-371d346bf53f]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.262s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586289304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6e09f4-7e51-4c2e-b74a-be0bb316cfab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:15Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Creating volume ce6e09f4-7e51-4c2e-b74a-be0bb316cfab {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:19 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:19 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab 1073741824 Jul 07 15:26:19 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f7af96-7c28-4674-8444-8335a4bd4132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cca3bd1-78b8-4fae-a551-6a2fd1da6b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:19 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 (8ee09247-44ef-4ba3-87b9-fd85a7596fa8): created successfully Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cca3bd1-78b8-4fae-a551-6a2fd1da6b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:19 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (0686f24a-392b-43d2-9143-6afbac55e81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2137c212-00c5-4e3a-a0b8-280fe2768950 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created volume successfully. Jul 07 15:26:19 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 Jul 07 15:26:19 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:20 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2" returned: 0 in 0.780s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:20 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab 1073741824" returned: 0 in 0.830s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:20 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab Jul 07 15:26:20 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:20 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 Jul 07 15:26:20 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:21 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.497s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151415336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e869aea-f549-4793-8bc9-8c5d2859a180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f463232aeae4793bc0a35399c97c602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:16Z,use_quota=True,user_id='b2ca4365a54f4672b81341dae9fcd158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Creating volume 9e869aea-f549-4793-8bc9-8c5d2859a180 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:21 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e872235-94c9-4f3a-a9d7-ccd68e5899ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87afb52e-fd71-42e1-aecf-da76c9bfde1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:21 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 1073741824 Jul 07 15:26:21 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:21 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2" returned: 1 in 0.800s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Downloaded image e1a8e1ce-9974-4b21-bf42-7a5b97799f7a ((None, [{'url': 'file:///opt/stack/data/glance/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'metadata': {}}])) to volume bae8e852-df0a-485b-b713-0679f57629e2 successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Temporary image e1a8e1ce-9974-4b21-bf42-7a5b97799f7a for user 423d694ec38f41d4bcd78f8776cdfcb1 is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Marking volume bae8e852-df0a-485b-b713-0679f57629e2 as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:26:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab (ce6e09f4-7e51-4c2e-b74a-be0bb316cfab): created successfully Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87afb52e-fd71-42e1-aecf-da76c9bfde1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (70d5a4a8-d6b6-4f46-ae05-1451441e3b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Copying metadata from image e1a8e1ce-9974-4b21-bf42-7a5b97799f7a to bae8e852-df0a-485b-b713-0679f57629e2. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Creating volume glance metadata for volume bae8e852-df0a-485b-b713-0679f57629e2 backed by image e1a8e1ce-9974-4b21-bf42-7a5b97799f7a with: {'image_id': 'e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4ceb28e03fcf8948ccc456fa213abd47', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:26:21 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9fbc6fef-1d1c-43c2-b109-1bfeddb015c6 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created volume successfully. Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b1d838-fbab-41fc-b352-98593f216606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae8e852-df0a-485b-b713-0679f57629e2', 'volume_size': 1, 'image_id': 'e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ceb28e03fcf8948ccc456fa213abd47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06d7a6a7e0964e97826e37ebf751a021', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c60903af53334600bde312a1ba3177cd9c5b08dd4122cfb7e6bd69ffb3c854aa89aba42253fbf1db7962f25378d3bbcce24e9467b7085c4e76552f1c3a8d6a9', 'id': 'e1a8e1ce-9974-4b21-bf42-7a5b97799f7a', 'created_at': datetime.datetime(2026, 7, 7, 13, 26, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 26, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1a8e1ce-9974-4b21-bf42-7a5b97799f7a/file', 'properties': {}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215514ec-d6a6-4066-b1c4-72384cab1eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Volume volume-bae8e852-df0a-485b-b713-0679f57629e2 (bae8e852-df0a-485b-b713-0679f57629e2): created successfully Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215514ec-d6a6-4066-b1c4-72384cab1eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Flow 'volume_create_manager' (671924c6-b730-4fea-8881-3038a32c4ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:21 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6146bf8e-316a-4fcc-b3e4-5ea06848424c tempest-VolumeImageDependencyTests-471287855 None] Created volume successfully. Jul 07 15:26:22 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 1073741824" returned: 0 in 0.835s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:22 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 Jul 07 15:26:22 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Acquiring lock "cinder-bae8e852-df0a-485b-b713-0679f57629e2-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Lock "cinder-bae8e852-df0a-485b-b713-0679f57629e2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Acquiring lock "cinder-quobyte-bae8e852-df0a-485b-b713-0679f57629e2" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Lock "cinder-quobyte-bae8e852-df0a-485b-b713-0679f57629e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d092f57-07a8-49a2-bac6-048901c81fea]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:22 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 Jul 07 15:26:22 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:22 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb97645-a84f-463d-9697-f4de736d2056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e869aea-f549-4793-8bc9-8c5d2859a180', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd6d707-2b54-4aa1-ae0b-6be9b3e142e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Volume volume-9e869aea-f549-4793-8bc9-8c5d2859a180 (9e869aea-f549-4793-8bc9-8c5d2859a180): created successfully Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd6d707-2b54-4aa1-ae0b-6be9b3e142e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Flow 'volume_create_manager' (2aa8147d-ac9c-4664-b54b-34460a06309a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:22 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-81eb690d-ef66-4359-8391-a647a8fcf41d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created volume successfully. Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-9e869aea-f549-4793-8bc9-8c5d2859a180-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-9e869aea-f549-4793-8bc9-8c5d2859a180-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:23 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2" returned: 0 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-quobyte-9e869aea-f549-4793-8bc9-8c5d2859a180" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-9e869aea-f549-4793-8bc9-8c5d2859a180" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fe5c7c-7511-4538-baf6-cc94b31af664]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:23 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 Jul 07 15:26:23 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:23 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 Jul 07 15:26:23 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:24 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2" returned: 1 in 0.760s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:24 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2 Jul 07 15:26:24 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:24 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180" returned: 0 in 0.759s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:24 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180 Jul 07 15:26:24 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:24 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bae8e852-df0a-485b-b713-0679f57629e2" returned: 0 in 0.656s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Lock "cinder-quobyte-bae8e852-df0a-485b-b713-0679f57629e2" released by "delete_volume" :: held 2.265s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Created reservations ['0320711d-c9cc-4f8c-8d3b-e4eb61d09133', '4d097c93-bad6-4c16-9899-d06eab071c11', '82e779c1-595f-4baf-8892-be78ac728a19', '03bb55c6-553d-4e92-b347-67e2e50380ba'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:24 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e869aea-f549-4793-8bc9-8c5d2859a180" returned: 0 in 0.673s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-9e869aea-f549-4793-8bc9-8c5d2859a180" released by "delete_volume" :: held 1.477s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created reservations ['7000ebf0-4b8f-44e6-9554-88ca034bcc7a', '8bb52f68-2096-4802-bcb8-1a22739b7ccb', '5a35fa32-7687-4b17-95de-1cf3d9a42e09', 'ac13fd57-0846-4744-b95c-3df374598a84'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:25 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:25 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:25 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:25 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:25 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.659s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Deleted volume successfully. Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-quobyte-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3ed7836d-0a19-49a0-b555-569b0609018e tempest-VolumeImageDependencyTests-471287855 None] Lock "cinder-bae8e852-df0a-485b-b713-0679f57629e2-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd28067-0214-4ddf-9a61-bc1c8c7c498f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:25 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Deleted volume successfully. Jul 07 15:26:25 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-05d99cdf-1ce1-4b52-a2d9-d82c5a860513 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-9e869aea-f549-4793-8bc9-8c5d2859a180-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:25 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab Jul 07 15:26:25 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:26 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab" returned: 0 in 0.808s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:26 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab Jul 07 15:26:26 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:27 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab" returned: 0 in 0.674s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab" released by "delete_volume" :: held 1.522s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created reservations ['44cd21d7-cc2e-467f-9c29-53a3233d7f2f', '02c23237-2e04-4f7e-9cd5-0e225db48d61', '8835f666-6ee8-40ef-b4c1-c4a5edef7a3f', 'c17c66f2-9f4b-4dca-99bc-9e5e6a300141'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:27 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:27 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-8ee09247-44ef-4ba3-87b9-fd85a7596fa8-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-8ee09247-44ef-4ba3-87b9-fd85a7596fa8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-quobyte-8ee09247-44ef-4ba3-87b9-fd85a7596fa8" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-8ee09247-44ef-4ba3-87b9-fd85a7596fa8" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b0f20-7c04-4301-b88c-bc56dbe74f52]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:28 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Deleted volume successfully. Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06e39f64-136e-442a-9153-7509c205bddd tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-ce6e09f4-7e51-4c2e-b74a-be0bb316cfab-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:28 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 Jul 07 15:26:28 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:28 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8" returned: 0 in 0.795s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:28 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8 Jul 07 15:26:28 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Flow 'volume_create_manager' (b4d23b28-8a30-4eff-a6db-9fb218391734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b623499-de31-4566-9de4-54e84ee510a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b623499-de31-4566-9de4-54e84ee510a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a59d627-3652-4b5b-ab9b-f913cecd1f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bdd2adbed6452583cbae65c61b40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:29Z,use_quota=True,user_id='9bfb272fb9174ad8bf6a09ce20faebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f06aaa-cfc3-4c2b-805c-9ebeb98a6b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f06aaa-cfc3-4c2b-805c-9ebeb98a6b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f131b34a-63c5-44c5-9d9c-c8106ec05cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f131b34a-63c5-44c5-9d9c-c8106ec05cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a59d627-3652-4b5b-ab9b-f913cecd1f18', 'volume_name': 'volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcabf8d-357f-434a-be64-3def4c9a39a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcabf8d-357f-434a-be64-3def4c9a39a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f86b26-a4e0-4a50-974a-fb0b6088a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:28 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Volume 8a59d627-3652-4b5b-ab9b-f913cecd1f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18', 'volume_size': 1} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a59d627-3652-4b5b-ab9b-f913cecd1f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bdd2adbed6452583cbae65c61b40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:29Z,use_quota=True,user_id='9bfb272fb9174ad8bf6a09ce20faebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Creating volume 8a59d627-3652-4b5b-ab9b-f913cecd1f18 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:28 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:28 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 1073741824 Jul 07 15:26:28 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:29 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8ee09247-44ef-4ba3-87b9-fd85a7596fa8" returned: 0 in 0.640s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-8ee09247-44ef-4ba3-87b9-fd85a7596fa8" released by "delete_volume" :: held 1.478s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created reservations ['53ec48f8-dc80-447b-a0bb-f04d383d12b2', '471542d7-a9b3-4314-9602-cafb58ba6024', '756515ba-2a3c-4b31-a2c5-176ef9570d1c', '0fdc56ba-9d0a-4b0b-a16d-7f0c5a987e3f'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:29 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:29 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:29 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 1073741824" returned: 0 in 0.841s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:29 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 Jul 07 15:26:29 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-2f008a69-084e-4d4a-8244-bdf1ad91e88f-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-2f008a69-084e-4d4a-8244-bdf1ad91e88f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-quobyte-2f008a69-084e-4d4a-8244-bdf1ad91e88f" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-2f008a69-084e-4d4a-8244-bdf1ad91e88f" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c18c6e-319d-42ef-8a4c-f79f9de4b714]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:30 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Deleted volume successfully. Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-790623f0-89f6-402f-b4ca-eb03e68419f5 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-8ee09247-44ef-4ba3-87b9-fd85a7596fa8-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:30 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f Jul 07 15:26:30 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:30 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18" returned: 0 in 0.678s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f86b26-a4e0-4a50-974a-fb0b6088a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754bde61-d729-45db-ae51-b830a8fde645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:30 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Volume volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 (8a59d627-3652-4b5b-ab9b-f913cecd1f18): created successfully Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754bde61-d729-45db-ae51-b830a8fde645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Flow 'volume_create_manager' (b4d23b28-8a30-4eff-a6db-9fb218391734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-33035ebb-7f8f-4c7b-b818-11d6177aa697 tempest-CinderUnicodeTest-1523529110 None] Created volume successfully. Jul 07 15:26:31 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f" returned: 0 in 0.787s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:31 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f Jul 07 15:26:31 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Flow 'volume_create_manager' (d783c3da-31db-44ce-9a82-716eff3a42ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c79bbe-10af-4c55-be50-c07956a6049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c79bbe-10af-4c55-be50-c07956a6049f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1486714134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfde2f26-7f3f-4073-ab3e-f2bf0b794954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bdd2adbed6452583cbae65c61b40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:31Z,use_quota=True,user_id='9bfb272fb9174ad8bf6a09ce20faebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43805f6a-6473-40ec-a900-f51e00607fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43805f6a-6473-40ec-a900-f51e00607fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23343c0-463d-4df4-9080-9b6fec32940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23343c0-463d-4df4-9080-9b6fec32940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfde2f26-7f3f-4073-ab3e-f2bf0b794954', 'volume_name': 'volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702d34c0-1ef7-4df0-b6c4-45421b92b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702d34c0-1ef7-4df0-b6c4-45421b92b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622802ef-24b7-4fcd-af29-f0592f0211df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:31 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Volume bfde2f26-7f3f-4073-ab3e-f2bf0b794954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954', 'volume_size': 1} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1486714134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfde2f26-7f3f-4073-ab3e-f2bf0b794954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bdd2adbed6452583cbae65c61b40d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:31Z,use_quota=True,user_id='9bfb272fb9174ad8bf6a09ce20faebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Creating volume bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:31 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:31 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 1073741824 Jul 07 15:26:31 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:31 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2f008a69-084e-4d4a-8244-bdf1ad91e88f" returned: 0 in 0.665s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-2f008a69-084e-4d4a-8244-bdf1ad91e88f" released by "delete_volume" :: held 1.494s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created reservations ['a696665e-7fe3-43b1-9e7a-97cb25b80527', '8b7d0c31-efd9-4ff6-8c91-1e7377b94c5c', 'f6e7c392-7e5e-48f4-b7e9-83d3bde8ea6d', 'c40c736f-98b3-4a68-9344-499f6103d624'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:31 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:31 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:32 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 1073741824" returned: 0 in 0.827s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-55047e4d-0b96-4f24-b659-43abc08922bf-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-55047e4d-0b96-4f24-b659-43abc08922bf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:32 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 Jul 07 15:26:32 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-quobyte-55047e4d-0b96-4f24-b659-43abc08922bf" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-55047e4d-0b96-4f24-b659-43abc08922bf" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:32 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.697s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[361a18de-61bc-4407-aa78-a21e623b0751]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:32 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Deleted volume successfully. Jul 07 15:26:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d7bf4590-a238-466c-8773-2acf3a39756d tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-2f008a69-084e-4d4a-8244-bdf1ad91e88f-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:32 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf Jul 07 15:26:32 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:33 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" returned: 0 in 0.692s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622802ef-24b7-4fcd-af29-f0592f0211df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f95bf2-ae6c-48c4-89df-c7482e62b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:33 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Volume volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 (bfde2f26-7f3f-4073-ab3e-f2bf0b794954): created successfully Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f95bf2-ae6c-48c4-89df-c7482e62b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Flow 'volume_create_manager' (d783c3da-31db-44ce-9a82-716eff3a42ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-43dcbfc3-b682-4bf6-87dc-bccd60024655 tempest-CinderUnicodeTest-1523529110 None] Created volume successfully. Jul 07 15:26:33 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf" returned: 0 in 0.776s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:33 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf Jul 07 15:26:33 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Creating offline snapshot fdaec2c9-2bfc-441f-87fd-0ee0012b87ff of volume bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af9faa-6b92-44a6-a4cf-1c5da97e96a3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:33 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 Jul 07 15:26:33 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:33 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-55047e4d-0b96-4f24-b659-43abc08922bf" returned: 0 in 0.678s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-55047e4d-0b96-4f24-b659-43abc08922bf" released by "delete_volume" :: held 1.510s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created reservations ['8bd2661b-9a75-4248-be1d-f91be539963d', '4b571abf-202a-4794-8e07-2bac02e8ffd2', '247999d1-33bc-4352-9bbd-78a7cf1b22ad', '53cf4cfe-e9a2-4caa-9b3c-289b39311a22'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:34 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:34 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:34 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:34 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff 1G Jul 07 15:26:34 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-87252214-a582-43e9-ab09-c1b4618a7636-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-87252214-a582-43e9-ab09-c1b4618a7636-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "cinder-quobyte-87252214-a582-43e9-ab09-c1b4618a7636" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-87252214-a582-43e9-ab09-c1b4618a7636" acquired by "delete_volume" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3da4a97-6770-40e5-a6d9-5cbe71a53673]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:34 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.692s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Deleted volume successfully. Jul 07 15:26:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-abb8f67a-28d1-4d44-9657-485c1fd86b25 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-55047e4d-0b96-4f24-b659-43abc08922bf-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:34 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 Jul 07 15:26:34 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:35 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff 1G" returned: 0 in 0.820s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:35 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff Jul 07 15:26:35 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:35 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636" returned: 0 in 0.787s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:35 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636 Jul 07 15:26:35 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:36 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" returned: 0 in 0.677s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:36 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff is being set with open permissions: ugo+rw Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:36 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff Jul 07 15:26:36 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:36 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-87252214-a582-43e9-ab09-c1b4618a7636" returned: 0 in 0.666s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-quobyte-87252214-a582-43e9-ab09-c1b4618a7636" released by "delete_volume" :: held 1.508s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Created reservations ['26541bd3-0dfb-4093-bd86-da3013a4a350', '5cd6c346-79bb-43cb-9f35-764a069f7a65', '161b38a4-8961-47bb-9b8b-306a71076732', '1f8fca70-8b6a-4414-ace9-9ed084da3766'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:36 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:36 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:36 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" returned: 0 in 0.650s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:36 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.info Jul 07 15:26:36 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:37 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.673s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Deleted volume successfully. Jul 07 15:26:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-06d4a0dd-907b-40fd-92c3-97974467b085 tempest-CreateVolumesFromSourceVolumeTest-1099102254 None] Lock "cinder-87252214-a582-43e9-ab09-c1b4618a7636-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:37 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.info" returned: 0 in 0.681s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:37 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.info is being set with open permissions: ugo+rw Jul 07 15:26:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:37 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.info Jul 07 15:26:37 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:38 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.info" returned: 0 in 0.695s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.395s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:38 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b0619ee8-f3ef-448b-9c51-a3c01b73e9a3 tempest-CinderUnicodeTest-1523529110 None] Create snapshot completed successfully Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "cinder-fdaec2c9-2bfc-441f-87fd-0ee0012b87ff-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-fdaec2c9-2bfc-441f-87fd-0ee0012b87ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "cinder-quobyte-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "cinder-quobyte-fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Deleting offline snapshot fdaec2c9-2bfc-441f-87fd-0ee0012b87ff of volume bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] snapshot_file for this snap is: volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd320ca-19cc-4ff7-9d18-ece6c37ef78a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:39 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff Jul 07 15:26:39 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Flow 'volume_create_manager' (670720da-87cd-4d68-8ee1-641a0d257289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff3e7be-29e7-41dd-8e85-4ccb6c2c1564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff3e7be-29e7-41dd-8e85-4ccb6c2c1564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-909120185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f387dc0-a21a-42f1-a4c4-6e061b196a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ef392325546789328d57afe669e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:40Z,use_quota=True,user_id='bcb98eb3976b45beb31167b9742e27c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e53341-dc4a-4aa4-b607-2774bdcb1b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e53341-dc4a-4aa4-b607-2774bdcb1b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a07901-537f-4c71-81f5-fdda2633a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a07901-537f-4c71-81f5-fdda2633a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f387dc0-a21a-42f1-a4c4-6e061b196a18', 'volume_name': 'volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37020a1a-3979-4e1f-8d0b-cb643d49da52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37020a1a-3979-4e1f-8d0b-cb643d49da52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9034b88a-87c0-4303-92a3-2d0dc4e31f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Volume 5f387dc0-a21a-42f1-a4c4-6e061b196a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18', 'volume_size': 1} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-909120185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f387dc0-a21a-42f1-a4c4-6e061b196a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ef392325546789328d57afe669e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:40Z,use_quota=True,user_id='bcb98eb3976b45beb31167b9742e27c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Creating volume 5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:39 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:39 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:26:39 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 1073741824 Jul 07 15:26:39 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d867b4ef-f658-444d-a0e0-41efd8dfa0ac]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:40 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 Jul 07 15:26:40 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:40 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 1073741824" returned: 0 in 0.808s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:40 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:40 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff Jul 07 15:26:40 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:40 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 Jul 07 15:26:40 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:41 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9034b88a-87c0-4303-92a3-2d0dc4e31f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794b8965-a8ab-4732-88c8-ce7eb5e3cf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:41 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Volume volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 (5f387dc0-a21a-42f1-a4c4-6e061b196a18): created successfully Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794b8965-a8ab-4732-88c8-ce7eb5e3cf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Flow 'volume_create_manager' (670720da-87cd-4d68-8ee1-641a0d257289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a549e02b-1dd3-4939-aaf3-df2f96f7ed62 tempest-VolumeDependencyTests-37312583 None] Created volume successfully. Jul 07 15:26:41 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" returned: 0 in 0.757s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:41 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff Jul 07 15:26:41 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Creating offline snapshot 943339ef-62d8-4785-9908-83af8e785030 of volume 5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eaa370-d602-4ee7-887d-68e945d7ded2]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:42 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954.fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" returned: 0 in 0.664s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-fdaec2c9-2bfc-441f-87fd-0ee0012b87ff" released by "_delete_snapshot" :: held 3.095s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:42 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 Jul 07 15:26:42 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" released by "delete_snapshot" :: held 3.123s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Created reservations ['5e83df3e-d6d6-4683-96a4-4fc2623c0db7', '9faed667-e6da-46c0-90ae-97f421cc753d', 'ec0d7aca-9ba9-4999-bd22-3bccf56a227c', '04fe49e1-36d4-4f37-8daf-9db258294c6b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:42 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Delete snapshot completed successfully. Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd39c3bb-c307-489c-bad5-24a66e70530c tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-fdaec2c9-2bfc-441f-87fd-0ee0012b87ff-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:42 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:42 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 1G Jul 07 15:26:42 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "cinder-bfde2f26-7f3f-4073-ab3e-f2bf0b794954-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-bfde2f26-7f3f-4073-ab3e-f2bf0b794954-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "cinder-quobyte-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78d5052-b309-4eda-961c-13e71ace3ee8]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:43 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 Jul 07 15:26:43 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:43 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 1G" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:43 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 Jul 07 15:26:43 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:44 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" returned: 0 in 0.773s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:44 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954 Jul 07 15:26:44 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:44 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030" returned: 0 in 0.694s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:44 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 is being set with open permissions: ugo+rw Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:44 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 Jul 07 15:26:44 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:44 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" returned: 0 in 0.678s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-bfde2f26-7f3f-4073-ab3e-f2bf0b794954" released by "delete_volume" :: held 1.521s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Created reservations ['a9b17052-3477-4d18-bce0-3588adda4835', '552a57db-6d8c-4b4c-b098-66af215878bb', '27e05a21-cec0-42bc-bdc8-430d3e843817', '3002eae2-3e45-4dbd-ba94-818e92013eaa'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:44 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:44 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:45 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030" returned: 0 in 0.663s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:45 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.info Jul 07 15:26:45 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "cinder-8a59d627-3652-4b5b-ab9b-f913cecd1f18-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-8a59d627-3652-4b5b-ab9b-f913cecd1f18-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "cinder-quobyte-8a59d627-3652-4b5b-ab9b-f913cecd1f18" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-8a59d627-3652-4b5b-ab9b-f913cecd1f18" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3799d019-b308-4619-8462-d0c7001ed152]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:45 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.690s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Deleted volume successfully. Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-02fc101a-638b-4511-95bb-15f227bf60ee tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-bfde2f26-7f3f-4073-ab3e-f2bf0b794954-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:45 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.info" returned: 0 in 0.664s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:45 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.info is being set with open permissions: ugo+rw Jul 07 15:26:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:45 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 Jul 07 15:26:45 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:45 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.info Jul 07 15:26:45 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:46 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:46 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.info" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.381s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:46 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18 Jul 07 15:26:46 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-98e17631-833e-410c-9dcc-1dd28be07262 tempest-VolumeDependencyTests-37312583 None] Create snapshot completed successfully Jul 07 15:26:47 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-8a59d627-3652-4b5b-ab9b-f913cecd1f18" returned: 0 in 0.643s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-quobyte-8a59d627-3652-4b5b-ab9b-f913cecd1f18" released by "delete_volume" :: held 1.504s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Created reservations ['ad1cd513-cb19-4db8-8c8e-4276474fbaf5', '674e2625-e7f0-4db9-9ea3-987e75b6cf2b', '79ed5ffd-5221-48b5-a91b-620cc1ee9443', 'ef161b06-a6e6-46b1-8021-ab3e0ac0f4ff'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:47 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:26:47 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Flow 'volume_create_manager' (c8efb97b-eea2-4ba7-89a6-017080e68be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6f385b-efc7-40ed-9e3c-a910d5257303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6f385b-efc7-40ed-9e3c-a910d5257303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-809566262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a1abfb-0ea9-49e5-a269-c245a739afed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ef392325546789328d57afe669e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=943339ef-62d8-4785-9908-83af8e785030,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:26:48Z,use_quota=True,user_id='bcb98eb3976b45beb31167b9742e27c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13228ff7-c419-45b9-b47e-1d4af8f7d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13228ff7-c419-45b9-b47e-1d4af8f7d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b2feee-c524-4f07-98a2-ce84a291c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b2feee-c524-4f07-98a2-ce84a291c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97a1abfb-0ea9-49e5-a269-c245a739afed', 'volume_name': 'volume-97a1abfb-0ea9-49e5-a269-c245a739afed', 'volume_size': 1, 'snapshot_id': '943339ef-62d8-4785-9908-83af8e785030'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:47 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2543df6e-bfc4-4809-9792-f6c18bfd6b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2543df6e-bfc4-4809-9792-f6c18bfd6b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b089a-02fa-4d66-a7e1-32edd8ccaa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Volume 97a1abfb-0ea9-49e5-a269-c245a739afed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97a1abfb-0ea9-49e5-a269-c245a739afed', 'volume_size': 1, 'snapshot_id': '943339ef-62d8-4785-9908-83af8e785030'} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.681s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:26:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Deleted volume successfully. Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-quobyte-943339ef-62d8-4785-9908-83af8e785030-97a1abfb-0ea9-49e5-a269-c245a739afed" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-98d45a47-e717-446a-b069-1146642d8938 tempest-CinderUnicodeTest-1523529110 None] Lock "cinder-8a59d627-3652-4b5b-ab9b-f913cecd1f18-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-943339ef-62d8-4785-9908-83af8e785030-97a1abfb-0ea9-49e5-a269-c245a739afed" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Creating volume 97a1abfb-0ea9-49e5-a269-c245a739afed from snapshot 943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-quobyte-97a1abfb-0ea9-49e5-a269-c245a739afed" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-97a1abfb-0ea9-49e5-a269-c245a739afed" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] snapshot: 943339ef-62d8-4785-9908-83af8e785030, volume: 97a1abfb-0ea9-49e5-a269-c245a739afed, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecd1405-75f3-4467-b011-12fb9346dd6a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:48 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 Jul 07 15:26:48 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:48 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030" returned: 0 in 0.805s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:26:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:26:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:26:48 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e695d-5826-4449-8183-2a15744212d5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:48 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 Jul 07 15:26:48 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:49 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18" returned: 0 in 0.812s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:49 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:26:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:49 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed Jul 07 15:26:49 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:54 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed" returned: 0 in 5.245s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:54 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960e3e8-93e4-4091-9b5e-5cce9b18c441]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:54 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 Jul 07 15:26:54 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:55 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18" returned: 0 in 0.973s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:55 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:26:55 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Converted 1024.00 MB image at 195.19 MB/s Jul 07 15:26:55 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed is being set with open permissions: ugo+rw Jul 07 15:26:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:55 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed Jul 07 15:26:55 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:56 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed" returned: 0 in 0.639s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-97a1abfb-0ea9-49e5-a269-c245a739afed" released by "_copy_volume_from_snapshot" :: held 8.579s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-943339ef-62d8-4785-9908-83af8e785030-97a1abfb-0ea9-49e5-a269-c245a739afed" released by "_create_volume_from_snapshot" :: held 8.609s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.632s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b089a-02fa-4d66-a7e1-32edd8ccaa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a1abfb-0ea9-49e5-a269-c245a739afed', 'volume_size': 1, 'snapshot_id': '943339ef-62d8-4785-9908-83af8e785030'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97ac7a7-5fc8-476a-81ec-3f906acf3cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:26:56 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Volume volume-97a1abfb-0ea9-49e5-a269-c245a739afed (97a1abfb-0ea9-49e5-a269-c245a739afed): created successfully Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97ac7a7-5fc8-476a-81ec-3f906acf3cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:26:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Flow 'volume_create_manager' (c8efb97b-eea2-4ba7-89a6-017080e68be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:26:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-94cda733-bdf1-4753-b669-65ba24b66be9 tempest-VolumeDependencyTests-37312583 None] Created volume successfully. Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-943339ef-62d8-4785-9908-83af8e785030-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-943339ef-62d8-4785-9908-83af8e785030-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-quobyte-5f387dc0-a21a-42f1-a4c4-6e061b196a18" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-5f387dc0-a21a-42f1-a4c4-6e061b196a18" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-quobyte-943339ef-62d8-4785-9908-83af8e785030" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-943339ef-62d8-4785-9908-83af8e785030" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Deleting offline snapshot 943339ef-62d8-4785-9908-83af8e785030 of volume 5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] snapshot_file for this snap is: volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c98f75-29b5-4bd1-86db-a0010c21df9c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:57 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 Jul 07 15:26:57 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:58 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030" returned: 0 in 0.748s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:26:58 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd5fa2-3468-426d-8608-e289bb0e14e6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:26:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:58 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 Jul 07 15:26:58 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:59 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18" returned: 0 in 0.717s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:59 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 Jul 07 15:26:59 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:26:59 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 07 15:26:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030" returned: 0 in 0.722s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:26:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:26:59 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030 Jul 07 15:26:59 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:00 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:00 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:00 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18.943339ef-62d8-4785-9908-83af8e785030" returned: 0 in 0.651s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-943339ef-62d8-4785-9908-83af8e785030" released by "_delete_snapshot" :: held 2.922s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-5f387dc0-a21a-42f1-a4c4-6e061b196a18" released by "delete_snapshot" :: held 2.947s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Created reservations ['2090e65c-96ee-4a82-b092-eec8b3adc413', '4f85af02-880b-4b8c-a6d8-bd8108032ea2', 'c478db38-69ed-470e-8da3-82d9097776c7', '29c6da1d-963d-4605-b893-e4cb68787a2b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Delete snapshot completed successfully. Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2c0e602c-da4b-4f3a-addc-363246e49dc0 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-943339ef-62d8-4785-9908-83af8e785030-delete_snapshot" released by "delete_snapshot" :: held 3.076s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:00 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.659s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-5f387dc0-a21a-42f1-a4c4-6e061b196a18-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Lock "cinder-5f387dc0-a21a-42f1-a4c4-6e061b196a18-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-quobyte-5f387dc0-a21a-42f1-a4c4-6e061b196a18" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-5f387dc0-a21a-42f1-a4c4-6e061b196a18" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[707e4efc-e52e-42a4-83c5-021a2a95e588]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:00 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 Jul 07 15:27:00 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:01 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18" returned: 0 in 0.745s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:01 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18 Jul 07 15:27:01 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:02 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5f387dc0-a21a-42f1-a4c4-6e061b196a18" returned: 0 in 0.634s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-5f387dc0-a21a-42f1-a4c4-6e061b196a18" released by "delete_volume" :: held 1.434s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Created reservations ['c085da71-686a-4fda-9e59-f9390c987fdb', '418f5965-37e9-477f-ac88-6e306b3a64a3', 'e718dd61-2038-457a-8f8a-9ffab3ff329c', '945f4ce5-f47d-48d2-9252-7b33a6eaf565'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:02 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:02 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-97a1abfb-0ea9-49e5-a269-c245a739afed-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:03 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.634s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-97a1abfb-0ea9-49e5-a269-c245a739afed-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Deleted volume successfully. Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9908afb4-febc-46a8-8af7-562fe68ce2cb tempest-VolumeDependencyTests-37312583 None] Lock "cinder-5f387dc0-a21a-42f1-a4c4-6e061b196a18-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "cinder-quobyte-97a1abfb-0ea9-49e5-a269-c245a739afed" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-97a1abfb-0ea9-49e5-a269-c245a739afed" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bbb409-5716-4507-88f7-df7421794f54]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:03 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed Jul 07 15:27:03 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:03 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed" returned: 0 in 0.748s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:03 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed Jul 07 15:27:03 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:04 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-97a1abfb-0ea9-49e5-a269-c245a739afed" returned: 0 in 0.632s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-quobyte-97a1abfb-0ea9-49e5-a269-c245a739afed" released by "delete_volume" :: held 1.415s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Created reservations ['7e40e0b3-5ea8-4d03-9375-85a52731f4c6', '6c4f11bd-dc09-4087-9748-371636d3ca52', 'cdc314f2-7697-4919-8724-77e73a22b46e', '9a38f8d5-8422-4281-9a84-8172fec1b5d6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:04 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:04 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:05 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.624s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:05 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Deleted volume successfully. Jul 07 15:27:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c4424792-47a7-4bc2-8ca7-8824011fb713 tempest-VolumeDependencyTests-37312583 None] Lock "cinder-97a1abfb-0ea9-49e5-a269-c245a739afed-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:14 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=102,cinder:UPDATE=133,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:27:15 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=91,cinder:INSERT=37,cinder:UPDATE=130,cinder:DELETE=16 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (d7bdeef6-45c7-433b-8762-09796158ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ee16e-e4cc-4eb0-8495-28f588926e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ee16e-e4cc-4eb0-8495-28f588926e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677992003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3f06c4-8c21-4b2c-b301-da4778ebc933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:21Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c4f85a-72fa-4d14-a549-3060ed575cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c4f85a-72fa-4d14-a549-3060ed575cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f620de41-faf7-47e1-8749-4b77865bdae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f620de41-faf7-47e1-8749-4b77865bdae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3f06c4-8c21-4b2c-b301-da4778ebc933', 'volume_name': 'volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4f3835-3acf-4acd-9d9a-b744c37febb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4f3835-3acf-4acd-9d9a-b744c37febb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73da2f1c-2cfd-488a-8541-f6f3aeb21b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Volume 6a3f06c4-8c21-4b2c-b301-da4778ebc933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933', 'volume_size': 1} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677992003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3f06c4-8c21-4b2c-b301-da4778ebc933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:21Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Creating volume 6a3f06c4-8c21-4b2c-b301-da4778ebc933 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:21 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:21 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 1073741824 Jul 07 15:27:21 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (1f4a72ef-ba9e-44aa-b091-deeafd939c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5ef285-d0ac-4fda-b956-32f22f915f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5ef285-d0ac-4fda-b956-32f22f915f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401312653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fb3a3f-535a-4b30-85c9-1c50b08c1780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:21Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d6200e-8393-40c5-81e2-739d52559234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d6200e-8393-40c5-81e2-739d52559234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef464a1c-1f23-4aba-89be-9950da327e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef464a1c-1f23-4aba-89be-9950da327e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fb3a3f-535a-4b30-85c9-1c50b08c1780', 'volume_name': 'volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0352dbc9-2b35-4903-849d-ff5830da6569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0352dbc9-2b35-4903-849d-ff5830da6569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f1bb74-26fc-4853-80e1-1319f46bfceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Volume 06fb3a3f-535a-4b30-85c9-1c50b08c1780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780', 'volume_size': 1} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (51f3dbb0-0774-4f64-988b-72f241465f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40586bf1-d2e3-473f-b6bb-76af7675b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40586bf1-d2e3-473f-b6bb-76af7675b222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019635131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e6d0ff-73eb-4409-aa71-d701af5f5eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:22Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfdf728-1f9a-4bb8-84af-086f25b848eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfdf728-1f9a-4bb8-84af-086f25b848eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f0333c-9f1b-4495-8e3d-29332f590abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f0333c-9f1b-4495-8e3d-29332f590abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e6d0ff-73eb-4409-aa71-d701af5f5eb3', 'volume_name': 'volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8517d117-0dcf-4ef7-a83a-e00c28a2212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8517d117-0dcf-4ef7-a83a-e00c28a2212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a6da9e-eb60-4b6c-8852-ac1bda31476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:21 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume f7e6d0ff-73eb-4409-aa71-d701af5f5eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3', 'volume_size': 1} Jul 07 15:27:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (e3caa70b-e263-4017-a3e0-1f8924eac4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fdeed3-1c70-4cb1-9253-23c254515192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fdeed3-1c70-4cb1-9253-23c254515192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905020386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfd1497-c289-41d8-ae57-5ebae0ed2d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:22Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c22f1fe-7bec-41a4-90bc-f26cfac27733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c22f1fe-7bec-41a4-90bc-f26cfac27733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ed0590-d3f9-4a61-a875-509db9a221ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ed0590-d3f9-4a61-a875-509db9a221ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfd1497-c289-41d8-ae57-5ebae0ed2d00', 'volume_name': 'volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4a725-2436-4aea-a63a-87dc5c7a2ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd4a725-2436-4aea-a63a-87dc5c7a2ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba2835-d08a-4c5f-89a2-60138d0d9916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Volume 4cfd1497-c289-41d8-ae57-5ebae0ed2d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00', 'volume_size': 1} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (0b4bccb2-71f9-42ae-af41-b6c70cec22a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c802530-1175-43cb-a9f5-a27cd53a5323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c802530-1175-43cb-a9f5-a27cd53a5323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168351411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a19f94-52fe-470a-b626-57a89510565b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:22Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b76998e-b0ae-4376-b380-fe2385713a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b76998e-b0ae-4376-b380-fe2385713a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305fa79-2ab7-4001-8341-7b0b12aa93b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305fa79-2ab7-4001-8341-7b0b12aa93b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a19f94-52fe-470a-b626-57a89510565b', 'volume_name': 'volume-52a19f94-52fe-470a-b626-57a89510565b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a3def1-5049-4896-9e85-7680efd68817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a3def1-5049-4896-9e85-7680efd68817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff4bafc-2238-4c3d-945b-387a9a5af232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Volume 52a19f94-52fe-470a-b626-57a89510565b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a19f94-52fe-470a-b626-57a89510565b', 'volume_size': 1} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:22 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 1073741824" returned: 0 in 1.281s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:22 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 Jul 07 15:27:22 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (c9aad2ec-5d1b-4b31-aa78-c9d4fdc0d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2782f3-4fb9-4463-8d72-4bb1e215bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2782f3-4fb9-4463-8d72-4bb1e215bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-959298129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fa11ea-fac9-4873-9c0e-64eeb7079b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:23Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b5b48f-6c5e-4cc0-b341-bc295e42810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b5b48f-6c5e-4cc0-b341-bc295e42810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2d7ee6-8cfd-4798-958f-ff3b4e4b072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2d7ee6-8cfd-4798-958f-ff3b4e4b072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fa11ea-fac9-4873-9c0e-64eeb7079b20', 'volume_name': 'volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8496626-8d5d-4a40-a3f7-1edb36cba71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8496626-8d5d-4a40-a3f7-1edb36cba71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd30f5a-2166-493f-a6bf-21e251cc4ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Volume 09fa11ea-fac9-4873-9c0e-64eeb7079b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20', 'volume_size': 1} Jul 07 15:27:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (7f9f4c52-0a58-4463-b64c-340fc813aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c69b39-089d-44c1-bab5-6dd1bed745e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c69b39-089d-44c1-bab5-6dd1bed745e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-656933614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea38620-cec4-4826-a1c6-0019d650f3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:23Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e789564-c0fa-491b-9bd4-d344e8bbc343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e789564-c0fa-491b-9bd4-d344e8bbc343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c015db90-a341-416d-9f60-72c8359bbcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c015db90-a341-416d-9f60-72c8359bbcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea38620-cec4-4826-a1c6-0019d650f3c9', 'volume_name': 'volume-bea38620-cec4-4826-a1c6-0019d650f3c9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3cd86-acdd-4778-9e9a-61ec736c0330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3cd86-acdd-4778-9e9a-61ec736c0330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81c7821-e982-4ffa-816b-b9d4d4e88c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Volume bea38620-cec4-4826-a1c6-0019d650f3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea38620-cec4-4826-a1c6-0019d650f3c9', 'volume_size': 1} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:23 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401312653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fb3a3f-535a-4b30-85c9-1c50b08c1780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:21Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Creating volume 06fb3a3f-535a-4b30-85c9-1c50b08c1780 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:23 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73da2f1c-2cfd-488a-8541-f6f3aeb21b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:23 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 1073741824 Jul 07 15:27:23 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccfb84a-edc4-40e0-81f5-eca40711ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Volume volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 (6a3f06c4-8c21-4b2c-b301-da4778ebc933): created successfully Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccfb84a-edc4-40e0-81f5-eca40711ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (d7bdeef6-45c7-433b-8762-09796158ff09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b58dac52-a0d1-41aa-9818-a29227dea1e7 tempest-CreateVolumesFromImageTest-1435122672 None] Created volume successfully. Jul 07 15:27:24 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 1073741824" returned: 0 in 0.893s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:24 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 Jul 07 15:27:24 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:24 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780" returned: 0 in 0.663s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019635131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e6d0ff-73eb-4409-aa71-d701af5f5eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:22Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Creating volume f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:24 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:24 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 1073741824 Jul 07 15:27:24 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f1bb74-26fc-4853-80e1-1319f46bfceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f6e8bb-7c95-4a29-8691-0e96a952dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Volume volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 (06fb3a3f-535a-4b30-85c9-1c50b08c1780): created successfully Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f6e8bb-7c95-4a29-8691-0e96a952dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (1f4a72ef-ba9e-44aa-b091-deeafd939c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:25 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-360026ae-47f1-4095-a1d9-e7bcb5b87866 tempest-CreateVolumesFromImageTest-1435122672 None] Created volume successfully. Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Flow 'volume_create_manager' (771af734-ccee-46b8-9e93-b2fd50630de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a6f7c9-29c6-456e-9a55-35c3491ef89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a6f7c9-29c6-456e-9a55-35c3491ef89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3f0c87-8dad-4b39-966a-6e1cd40848c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934b178106e14b95a222b8d7a083f041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:25Z,use_quota=True,user_id='898ebe2137154a6e9681236c2603fbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(306b6a1b-32cd-42f9-ac58-c852222c4098),volume_type_id=306b6a1b-32cd-42f9-ac58-c852222c4098)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e377636-392d-4e15-a0c4-96c05d4f714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e377636-392d-4e15-a0c4-96c05d4f714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5d860e-cfcc-458c-8ff2-fe3fb9e7d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5d860e-cfcc-458c-8ff2-fe3fb9e7d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d3f0c87-8dad-4b39-966a-6e1cd40848c3', 'volume_name': 'volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3', 'volume_size': 1, 'image_id': '2c41a5f5-99c2-4a43-b21a-228f67138404', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c41a5f5-99c2-4a43-b21a-228f67138404', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be2c175b21a2053e345f22d6f416a988', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '934b178106e14b95a222b8d7a083f041', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08d6438dc861db95e6cd566f18000a2f4670f3f47f783c75666fe0c5c3529e11202aeb6cabb92643a735b4c7e9b2f84ee9e53bddcd819810df9bcc245dec322b', 'id': '2c41a5f5-99c2-4a43-b21a-228f67138404', 'created_at': datetime.datetime(2026, 7, 7, 13, 27, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c41a5f5-99c2-4a43-b21a-228f67138404/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384d2626-71f3-4480-b00a-7a1473419601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384d2626-71f3-4480-b00a-7a1473419601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5085e333-c6e2-4d35-bd41-52ebe32e0cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Volume 4d3f0c87-8dad-4b39-966a-6e1cd40848c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3', 'volume_size': 1, 'image_id': '2c41a5f5-99c2-4a43-b21a-228f67138404', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c41a5f5-99c2-4a43-b21a-228f67138404', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be2c175b21a2053e345f22d6f416a988', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '934b178106e14b95a222b8d7a083f041', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08d6438dc861db95e6cd566f18000a2f4670f3f47f783c75666fe0c5c3529e11202aeb6cabb92643a735b4c7e9b2f84ee9e53bddcd819810df9bcc245dec322b', 'id': '2c41a5f5-99c2-4a43-b21a-228f67138404', 'created_at': datetime.datetime(2026, 7, 7, 13, 27, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c41a5f5-99c2-4a43-b21a-228f67138404/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Trying to clone 4d3f0c87-8dad-4b39-966a-6e1cd40848c3 from image 2c41a5f5-99c2-4a43-b21a-228f67138404 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c41a5f5-99c2-4a43-b21a-228f67138404', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:27:25 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:27:25 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Image download 0.00 MB at 0.00 MB/s Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 1073741824" returned: 0 in 0.882s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:25 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 Jul 07 15:27:25 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed025742-31a2-4285-9b2f-935f37f7fedf]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:26 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD Jul 07 15:27:26 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:26 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" returned: 0 in 0.651s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.236s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905020386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfd1497-c289-41d8-ae57-5ebae0ed2d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:22Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Creating volume 4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:26 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a6da9e-eb60-4b6c-8852-ac1bda31476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:26 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 1073741824 Jul 07 15:27:26 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d119f5ec-d467-407e-9fcf-4c1f8773336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:26 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 (f7e6d0ff-73eb-4409-aa71-d701af5f5eb3): created successfully Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d119f5ec-d467-407e-9fcf-4c1f8773336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (51f3dbb0-0774-4f64-988b-72f241465f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e940cb9a-ed74-49c9-8144-b093b4b0ed53 tempest-CreateVolumesFromSnapshotTest-925729344 None] Created volume successfully. Jul 07 15:27:26 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:26 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD Jul 07 15:27:26 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:27 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 1073741824" returned: 0 in 0.848s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:27 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD" returned: 1 in 0.725s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Temporary image 2c41a5f5-99c2-4a43-b21a-228f67138404 is fetched for user 898ebe2137154a6e9681236c2603fbc7. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:27 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 Jul 07 15:27:27 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95d4de-0bf6-420f-a831-66703784c86d]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:27 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD Jul 07 15:27:27 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:28 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.677s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168351411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a19f94-52fe-470a-b626-57a89510565b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:22Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Creating volume 52a19f94-52fe-470a-b626-57a89510565b {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:28 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:28 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b 1073741824 Jul 07 15:27:28 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba2835-d08a-4c5f-89a2-60138d0d9916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f304b2d7-8536-4d5f-97cf-98eb16752d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:28 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Volume volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 (4cfd1497-c289-41d8-ae57-5ebae0ed2d00): created successfully Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f304b2d7-8536-4d5f-97cf-98eb16752d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (e3caa70b-e263-4017-a3e0-1f8924eac4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e72bb9b6-f3da-4fbd-9f55-65f992f9041a tempest-ProjectReaderTests-1961743153 None] Created volume successfully. Jul 07 15:27:28 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:28 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD Jul 07 15:27:28 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:29 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b 1073741824" returned: 0 in 0.925s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:29 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD" returned: 1 in 0.803s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:29 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b Jul 07 15:27:29 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:29 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b" returned: 0 in 0.652s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.964s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-959298129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fa11ea-fac9-4873-9c0e-64eeb7079b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:23Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Creating volume 09fa11ea-fac9-4873-9c0e-64eeb7079b20 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:29 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:29 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 1073741824 Jul 07 15:27:29 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff4bafc-2238-4c3d-945b-387a9a5af232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a19f94-52fe-470a-b626-57a89510565b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d7b80d-072d-4719-bde1-4bc790654aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:29 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Volume volume-52a19f94-52fe-470a-b626-57a89510565b (52a19f94-52fe-470a-b626-57a89510565b): created successfully Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d7b80d-072d-4719-bde1-4bc790654aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:29 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (0b4bccb2-71f9-42ae-af41-b6c70cec22a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3137c654-a0f5-4a0e-832b-f872120332af tempest-CreateVolumesFromImageTest-1435122672 None] Created volume successfully. Jul 07 15:27:30 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 1073741824" returned: 0 in 0.800s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:30 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 Jul 07 15:27:30 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:31 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20" returned: 0 in 0.643s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.036s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-656933614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea38620-cec4-4826-a1c6-0019d650f3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f630db282598425da003399be03dc774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:23Z,use_quota=True,user_id='c06f008185d649099e6d016567c297ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Creating volume bea38620-cec4-4826-a1c6-0019d650f3c9 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:31 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd30f5a-2166-493f-a6bf-21e251cc4ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:31 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 1073741824 Jul 07 15:27:31 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b3c6e8-04ac-4ae0-9b11-860f1e34bbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:31 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Volume volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 (09fa11ea-fac9-4873-9c0e-64eeb7079b20): created successfully Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b3c6e8-04ac-4ae0-9b11-860f1e34bbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (c9aad2ec-5d1b-4b31-aa78-c9d4fdc0d867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b1dad6d6-a24f-4a64-9f47-bfa3e4e63820 tempest-CreateVolumesFromImageTest-1435122672 None] Created volume successfully. Jul 07 15:27:32 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 1073741824" returned: 0 in 0.815s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:32 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 Jul 07 15:27:32 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:32 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9" returned: 0 in 0.640s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Creating offline snapshot 68112303-2866-4ed0-a037-65ab3a67f11c of volume f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81c7821-e982-4ffa-816b-b9d4d4e88c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea38620-cec4-4826-a1c6-0019d650f3c9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a747099-7ecd-4544-a526-d732db7811ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44197a2-b84d-4027-93a5-0fd3f8ec85b4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:32 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Volume volume-bea38620-cec4-4826-a1c6-0019d650f3c9 (bea38620-cec4-4826-a1c6-0019d650f3c9): created successfully Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a747099-7ecd-4544-a526-d732db7811ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:32 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Flow 'volume_create_manager' (7f9f4c52-0a58-4463-b64c-340fc813aaec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:32 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0ea245fa-6a7e-4c15-89f6-2ea144b088f8 tempest-CreateVolumesFromImageTest-1435122672 None] Created volume successfully. Jul 07 15:27:32 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 Jul 07 15:27:32 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-bea38620-cec4-4826-a1c6-0019d650f3c9-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-bea38620-cec4-4826-a1c6-0019d650f3c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-quobyte-bea38620-cec4-4826-a1c6-0019d650f3c9" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-bea38620-cec4-4826-a1c6-0019d650f3c9" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46d47bf-9090-4877-b4a5-d1ca7cd8e4a0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:33 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 Jul 07 15:27:33 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:33 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:33 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c 1G Jul 07 15:27:33 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:33 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9" returned: 0 in 0.767s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:33 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9 Jul 07 15:27:33 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:34 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c 1G" returned: 0 in 0.799s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:34 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c Jul 07 15:27:34 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:34 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-bea38620-cec4-4826-a1c6-0019d650f3c9" returned: 0 in 0.655s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-bea38620-cec4-4826-a1c6-0019d650f3c9" released by "delete_volume" :: held 1.461s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Created reservations ['9ea56fdd-8d20-40de-b08c-81f8aa0dd256', '849b8984-1474-4364-8a70-9b27e2f62bef', '0221df5e-5a75-4103-b064-7b2382b7d020', 'cda49403-47b0-4056-93d0-d35fb03893fc'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:34 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:34 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:35 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c" returned: 0 in 0.702s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:35 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c is being set with open permissions: ugo+rw Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:35 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c Jul 07 15:27:35 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-09fa11ea-fac9-4873-9c0e-64eeb7079b20-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-09fa11ea-fac9-4873-9c0e-64eeb7079b20-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-quobyte-09fa11ea-fac9-4873-9c0e-64eeb7079b20" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:35 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.662s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-09fa11ea-fac9-4873-9c0e-64eeb7079b20" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Deleted volume successfully. Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b7f0bb-fd01-4488-a00c-7e31376026b5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-fc1bb41a-49e1-4443-a708-6923233b5eea tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-bea38620-cec4-4826-a1c6-0019d650f3c9-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:35 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 Jul 07 15:27:35 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:35 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:35 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.info Jul 07 15:27:35 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:36 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20" returned: 0 in 0.770s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:36 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20 Jul 07 15:27:36 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:36 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.info" returned: 0 in 0.681s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:36 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.info is being set with open permissions: ugo+rw Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:36 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.info Jul 07 15:27:36 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:36 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-09fa11ea-fac9-4873-9c0e-64eeb7079b20" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-09fa11ea-fac9-4873-9c0e-64eeb7079b20" released by "delete_volume" :: held 1.476s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Created reservations ['ac836a4b-3e5a-431e-a293-18581e42378d', '5ff74819-970a-4e6e-ac8b-4345aba850bd', '938899b8-a9f8-4cd2-805a-d06e925e0eab', 'f2f0e51a-bf80-4bab-94cc-0d4a2f69b0f1'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:36 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:36 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:37 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.info" returned: 0 in 0.652s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.479s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Creating offline snapshot 3da089db-20e7-45fb-b17b-2ff4e745f2e0 of volume 4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:27:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-df7b3625-c082-42e2-8d62-fcb7b17eaccf tempest-CreateVolumesFromSnapshotTest-925729344 None] Create snapshot completed successfully Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[03deee9a-337d-4630-b785-f2c885d9d9d9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:37 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 Jul 07 15:27:37 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-52a19f94-52fe-470a-b626-57a89510565b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-52a19f94-52fe-470a-b626-57a89510565b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-quobyte-52a19f94-52fe-470a-b626-57a89510565b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-52a19f94-52fe-470a-b626-57a89510565b" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d21cd7c-f8e5-4c51-8825-bd34e83c9c37]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:37 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.686s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Deleted volume successfully. Jul 07 15:27:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4e5002e1-3594-4045-87d0-d9248b16568b tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-09fa11ea-fac9-4873-9c0e-64eeb7079b20-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:37 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b Jul 07 15:27:37 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:38 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" returned: 0 in 0.861s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:38 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 1G Jul 07 15:27:38 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:38 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b" returned: 0 in 0.816s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:38 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b Jul 07 15:27:38 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (cb49318c-928e-4ed1-a6a7-f86541231954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9cf3ad-57f8-4297-b7f3-89cc42043036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9cf3ad-57f8-4297-b7f3-89cc42043036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557801801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd68e46-1b54-4fe1-81ba-c928c5d655fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:39Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5514fb-d93c-4837-861d-b0d8650de45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5514fb-d93c-4837-861d-b0d8650de45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a670350-6e9b-4458-8a48-dd243dd85225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a670350-6e9b-4458-8a48-dd243dd85225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd68e46-1b54-4fe1-81ba-c928c5d655fc', 'volume_name': 'volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b4b0cd-e981-4f22-8a3d-fb4b9fb7afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b4b0cd-e981-4f22-8a3d-fb4b9fb7afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d38077-f206-46f4-8245-bfa956677728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:38 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume 9cd68e46-1b54-4fe1-81ba-c928c5d655fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc', 'volume_size': 1} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:38 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 1G" returned: 0 in 0.883s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:39 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 Jul 07 15:27:39 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (141cce55-c412-4770-a973-b0d19b1beb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d35ce0-273c-4802-b420-0aefe053b2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d35ce0-273c-4802-b420-0aefe053b2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773875063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383b5c75-190e-4774-bba6-dc39bb440f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:39Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dedd4d-77af-4045-8dad-143d3a84232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dedd4d-77af-4045-8dad-143d3a84232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65848487-5779-4fa9-9d44-f6dc27784acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65848487-5779-4fa9-9d44-f6dc27784acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383b5c75-190e-4774-bba6-dc39bb440f74', 'volume_name': 'volume-383b5c75-190e-4774-bba6-dc39bb440f74', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3a4e33-999d-47cb-9905-111d9314d0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3a4e33-999d-47cb-9905-111d9314d0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab9ccb6-2c55-4a23-8c0b-c16b0feb0e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume 383b5c75-190e-4774-bba6-dc39bb440f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383b5c75-190e-4774-bba6-dc39bb440f74', 'volume_size': 1} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:39 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-52a19f94-52fe-470a-b626-57a89510565b" returned: 0 in 0.892s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-52a19f94-52fe-470a-b626-57a89510565b" released by "delete_volume" :: held 1.772s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Created reservations ['242e2dd7-c167-43d5-80d0-3b60bd9606f2', 'f9909428-3f44-42da-a1d4-177b306063b1', 'd703955a-825b-4510-bb21-27096b5a575a', '2ca3c4fa-2708-4569-a03b-dd2923cec84b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (eb9cd5e1-11bd-408b-be9d-d6b3a75eeb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28466022-fcd2-4626-86ab-7f894f78da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28466022-fcd2-4626-86ab-7f894f78da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-67531748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:39Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6422acd6-3bdb-4a64-81c4-2749c709b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6422acd6-3bdb-4a64-81c4-2749c709b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f17f160-ba12-4168-ab58-4285de907e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f17f160-ba12-4168-ab58-4285de907e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8', 'volume_name': 'volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f22fc3-b4f9-4634-89da-3b00d164e3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f22fc3-b4f9-4634-89da-3b00d164e3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9c9cf9-1345-45c7-8278-b874d6be49c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume 7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8', 'volume_size': 1} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:39 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:39 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:39 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0" returned: 0 in 0.820s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:39 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 is being set with open permissions: ugo+rw Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-06fb3a3f-535a-4b30-85c9-1c50b08c1780-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:39 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 Jul 07 15:27:39 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (bb9cd315-b480-41bd-b546-a44301362db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e16e5a-59d8-4232-a80d-51c7d7816e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-06fb3a3f-535a-4b30-85c9-1c50b08c1780-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e16e5a-59d8-4232-a80d-51c7d7816e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317147147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d9c830-df8c-4adc-ad82-8b371977c9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:40Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baaa3881-abbb-473c-a756-cff94764bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baaa3881-abbb-473c-a756-cff94764bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eec6612-43ca-4b45-8cde-8f027df06fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eec6612-43ca-4b45-8cde-8f027df06fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d9c830-df8c-4adc-ad82-8b371977c9f5', 'volume_name': 'volume-94d9c830-df8c-4adc-ad82-8b371977c9f5', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392323e2-7d51-4026-a44e-7e07c59372a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392323e2-7d51-4026-a44e-7e07c59372a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95750fb-bca6-4b2d-bfd8-e8072f193cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume 94d9c830-df8c-4adc-ad82-8b371977c9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d9c830-df8c-4adc-ad82-8b371977c9f5', 'volume_size': 1} Jul 07 15:27:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-quobyte-06fb3a3f-535a-4b30-85c9-1c50b08c1780" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-06fb3a3f-535a-4b30-85c9-1c50b08c1780" acquired by "delete_volume" :: waited 0.023s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7110e90-a5c0-4858-be97-f9439c30019e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:40 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 Jul 07 15:27:40 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:40 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (b6483920-1c7c-4e7d-a3f3-bce8694ef2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66cdbd3-c0f9-48a9-bd5e-fb32526b2772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.900s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Deleted volume successfully. Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66cdbd3-c0f9-48a9-bd5e-fb32526b2772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414033620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ef5d4-c9ef-40c1-95e6-3545a8e69a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:40Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ee0202-f604-4e50-9da1-67948f66c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ee0202-f604-4e50-9da1-67948f66c66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c6c5ab-bfa0-4aba-a010-4407393db506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c6c5ab-bfa0-4aba-a010-4407393db506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21ef5d4-c9ef-40c1-95e6-3545a8e69a87', 'volume_name': 'volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f6cc83-9f23-4eb5-9c97-c76b54530d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f6cc83-9f23-4eb5-9c97-c76b54530d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3eecc5-c391-473f-8949-ef42254ffd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:40 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume f21ef5d4-c9ef-40c1-95e6-3545a8e69a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87', 'volume_size': 1} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bff7131c-8009-4d23-86dd-82bb468ed864 tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-52a19f94-52fe-470a-b626-57a89510565b-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:40 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0" returned: 0 in 0.892s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:40 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.info Jul 07 15:27:40 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:41 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780" returned: 0 in 0.910s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:41 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780 Jul 07 15:27:41 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:41 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.info" returned: 0 in 0.651s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:41 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.info is being set with open permissions: ugo+rw Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:41 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.info Jul 07 15:27:41 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:41 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-06fb3a3f-535a-4b30-85c9-1c50b08c1780" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-06fb3a3f-535a-4b30-85c9-1c50b08c1780" released by "delete_volume" :: held 1.639s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Created reservations ['21b3dc25-8dbf-4bf1-9e66-89d0b72a3204', '361d120c-cc87-4b19-a981-c786f5fddc69', '4a34e6d9-0121-4272-ab1c-e32b72430524', '1af43626-f9ca-4280-b841-c469ed0d25c8'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:41 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:41 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:42 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.info" returned: 0 in 0.643s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.843s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.954s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3f0c87-8dad-4b39-966a-6e1cd40848c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934b178106e14b95a222b8d7a083f041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:25Z,use_quota=True,user_id='898ebe2137154a6e9681236c2603fbc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(306b6a1b-32cd-42f9-ac58-c852222c4098),volume_type_id=306b6a1b-32cd-42f9-ac58-c852222c4098)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Creating volume 4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:42 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:42 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 1073741824 Jul 07 15:27:42 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-6a3f06c4-8c21-4b2c-b301-da4778ebc933-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-6a3f06c4-8c21-4b2c-b301-da4778ebc933-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:42 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4e29f0d4-567c-4649-a0c0-08d1922a0539 tempest-ProjectReaderTests-1961743153 None] Create snapshot completed successfully Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "cinder-quobyte-6a3f06c4-8c21-4b2c-b301-da4778ebc933" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-6a3f06c4-8c21-4b2c-b301-da4778ebc933" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22e426-71a0-4139-beff-b007099350be]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:42 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 Jul 07 15:27:42 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:42 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.670s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:42 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Deleted volume successfully. Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d683f68-ac02-48be-b3ab-10e47ffccfae tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-06fb3a3f-535a-4b30-85c9-1c50b08c1780-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:42 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 1073741824" returned: 0 in 0.883s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:43 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 Jul 07 15:27:43 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:43 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933" returned: 0 in 0.818s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:43 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933 Jul 07 15:27:43 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-3da089db-20e7-45fb-b17b-2ff4e745f2e0-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-3da089db-20e7-45fb-b17b-2ff4e745f2e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-3da089db-20e7-45fb-b17b-2ff4e745f2e0" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-3da089db-20e7-45fb-b17b-2ff4e745f2e0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Deleting offline snapshot 3da089db-20e7-45fb-b17b-2ff4e745f2e0 of volume 4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] snapshot_file for this snap is: volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2052f1-87b3-4b00-af83-24adbe0ff52c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:43 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" returned: 0 in 0.661s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.847s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557801801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd68e46-1b54-4fe1-81ba-c928c5d655fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:39Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Creating volume 9cd68e46-1b54-4fe1-81ba-c928c5d655fc {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:43 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:43 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc 1073741824 Jul 07 15:27:43 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:43 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Attempting download of 2c41a5f5-99c2-4a43-b21a-228f67138404 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c41a5f5-99c2-4a43-b21a-228f67138404', 'metadata': {}}])) to volume 4d3f0c87-8dad-4b39-966a-6e1cd40848c3. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:27:43 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6487596-9725-4ce6-9882-cc498a981c7e]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c41a5f5-99c2-4a43-b21a-228f67138404_5h86jvq0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:43 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6a3f06c4-8c21-4b2c-b301-da4778ebc933" returned: 0 in 0.729s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-quobyte-6a3f06c4-8c21-4b2c-b301-da4778ebc933" released by "delete_volume" :: held 1.603s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Created reservations ['ea49a658-79ee-4395-abf2-75961df5954d', 'c391743f-aec6-49d8-8f89-25cb3e37d00a', 'cd0ab348-51fb-46ae-80e8-aae10079c6f0', '6a0fbf71-47b0-475a-b043-e83a6b856912'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:43 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c41a5f5-99c2-4a43-b21a-228f67138404_5h86jvq0 Jul 07 15:27:43 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:43 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:43 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:44 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0" returned: 0 in 1.036s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4506f0-0f3c-44d4-8947-945f4ea73e68]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:44 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c41a5f5-99c2-4a43-b21a-228f67138404_5h86jvq0" returned: 0 in 0.940s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c41a5f5-99c2-4a43-b21a-228f67138404_5h86jvq0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:44 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.782s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Deleted volume successfully. Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9d2b9416-b8a0-4e62-91c7-dfda52ff4d8f tempest-CreateVolumesFromImageTest-1435122672 None] Lock "cinder-6a3f06c4-8c21-4b2c-b301-da4778ebc933-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:44 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc 1073741824" returned: 0 in 1.139s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:44 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 Jul 07 15:27:44 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:44 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c41a5f5-99c2-4a43-b21a-228f67138404_5h86jvq0 Jul 07 15:27:44 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:44 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc Jul 07 15:27:44 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:45 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c41a5f5-99c2-4a43-b21a-228f67138404_5h86jvq0" returned: 1 in 0.920s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:45 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c41a5f5-99c2-4a43-b21a-228f67138404_5h86jvq0' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc" returned: 0 in 0.811s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41492bb-81e6-4946-bc90-c0ee4b826e5a]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.517s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773875063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383b5c75-190e-4774-bba6-dc39bb440f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:39Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Creating volume 383b5c75-190e-4774-bba6-dc39bb440f74 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:45 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:45 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 1073741824 Jul 07 15:27:45 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:45 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d38077-f206-46f4-8245-bfa956677728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd3870c-ed9e-45d7-827f-af33d14c43e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" returned: 0 in 1.091s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:45 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc (9cd68e46-1b54-4fe1-81ba-c928c5d655fc): created successfully Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd3870c-ed9e-45d7-827f-af33d14c43e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:45 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (cb49318c-928e-4ed1-a6a7-f86541231954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:45 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 Jul 07 15:27:45 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e9c8c483-5a68-4908-80b0-49e2b987db38 tempest-CreateVolumesFromSnapshotTest-925729344 None] Created volume successfully. Jul 07 15:27:45 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD Jul 07 15:27:45 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:46 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:46 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 1073741824" returned: 0 in 0.938s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:46 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0" returned: 0 in 0.895s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:46 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0 Jul 07 15:27:46 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:46 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 Jul 07 15:27:46 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:46 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD Jul 07 15:27:46 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:47 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00.3da089db-20e7-45fb-b17b-2ff4e745f2e0" returned: 0 in 0.765s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-3da089db-20e7-45fb-b17b-2ff4e745f2e0" released by "_delete_snapshot" :: held 3.913s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" released by "delete_snapshot" :: held 3.945s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:47 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74" returned: 0 in 0.798s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.929s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-67531748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:39Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Creating volume 7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:47 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:47 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab9ccb6-2c55-4a23-8c0b-c16b0feb0e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383b5c75-190e-4774-bba6-dc39bb440f74', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134b8366-f3dd-44f9-985c-535f9eb060a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:47 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 1073741824 Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD" returned: 1 in 0.931s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:27:47 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] 2c41a5f5-99c2-4a43-b21a-228f67138404 was raw, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume volume-383b5c75-190e-4774-bba6-dc39bb440f74 (383b5c75-190e-4774-bba6-dc39bb440f74): created successfully Jul 07 15:27:47 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 Jul 07 15:27:47 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134b8366-f3dd-44f9-985c-535f9eb060a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (141cce55-c412-4770-a973-b0d19b1beb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3d8c1d39-ff40-4229-9355-68ef0ee88983 tempest-CreateVolumesFromSnapshotTest-925729344 None] Created volume successfully. Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Created reservations ['4ad9ac87-44e1-48aa-acda-c75725bc4989', 'c0fefb9f-15c1-46bc-99ef-485d11431c79', 'bb96b4af-9db8-44f4-b1a2-ab0774fef237', '5807d75e-198c-487e-b4b5-9d11154089bc'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Delete snapshot completed successfully. Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-008c8b2e-0378-427c-b012-7406a7c57b93 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-3da089db-20e7-45fb-b17b-2ff4e745f2e0-delete_snapshot" released by "delete_snapshot" :: held 4.300s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Flow 'volume_create_manager' (99f4d1ac-807e-4595-be1a-11bc1603929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7f11e0-d610-4ecf-951b-2b02ad4bbccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7f11e0-d610-4ecf-951b-2b02ad4bbccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2037445753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13247e23-5ea1-46b0-8aa0-1d61314c9ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c827b952a04d24b826404b67a42b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:48Z,use_quota=True,user_id='ac00b664d72842a9b95f6284b505bb9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ce9555-cbe9-4ffb-982e-67018a5c961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ce9555-cbe9-4ffb-982e-67018a5c961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261c9f43-d4e8-42a9-b225-b161e4c4e250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261c9f43-d4e8-42a9-b225-b161e4c4e250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13247e23-5ea1-46b0-8aa0-1d61314c9ad4', 'volume_name': 'volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd1e441-cf0d-4157-8e7f-ecde44b40269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd1e441-cf0d-4157-8e7f-ecde44b40269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729b7485-1c7d-4bcb-ae97-682abca13511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:47 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Volume 13247e23-5ea1-46b0-8aa0-1d61314c9ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4', 'volume_size': 1} Jul 07 15:27:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:48 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" returned: 0 in 0.827s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c41a5f5-99c2-4a43-b21a-228f67138404_ezbem_0jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:27:48 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:48 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 1073741824" returned: 0 in 0.900s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:48 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 1G Jul 07 15:27:48 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:48 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 Jul 07 15:27:48 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-4cfd1497-c289-41d8-ae57-5ebae0ed2d00-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-4cfd1497-c289-41d8-ae57-5ebae0ed2d00-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff26a8b-7a9d-467b-9c47-2cf2b5b0d3a6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:49 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 Jul 07 15:27:49 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:49 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 1G" returned: 0 in 0.756s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:49 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d7fba1-d4b0-4045-b323-52fd6457d0bc]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8" returned: 0 in 0.734s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.191s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317147147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d9c830-df8c-4adc-ad82-8b371977c9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:40Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Creating volume 94d9c830-df8c-4adc-ad82-8b371977c9f5 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:49 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:49 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 1073741824 Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9c9cf9-1345-45c7-8278-b874d6be49c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:49 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1a2db-5582-4100-9afe-054c5023846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:49 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 (7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8): created successfully Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1a2db-5582-4100-9afe-054c5023846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (eb9cd5e1-11bd-408b-be9d-d6b3a75eeb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fcdecf95-8719-4f9a-9951-9145ed2da340 tempest-CreateVolumesFromSnapshotTest-925729344 None] Created volume successfully. Jul 07 15:27:49 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 Jul 07 15:27:49 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:49 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:49 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00 Jul 07 15:27:49 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:50 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" returned: 0 in 0.867s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:50 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 Jul 07 15:27:50 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:50 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 1073741824" returned: 0 in 1.068s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:50 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 Jul 07 15:27:50 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:50 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" returned: 0 in 0.716s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-4cfd1497-c289-41d8-ae57-5ebae0ed2d00" released by "delete_volume" :: held 1.613s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Created reservations ['4f7d5f88-3c74-4e57-8e3a-b2244e5e59a4', 'e2db0d3b-dff8-4d0b-a78e-e10eb2401ae0', '1720973c-b4f8-4fb3-b39a-8ff0dc0cb8f7', '499aa773-5c1c-4632-bbe6-2cadc5e48395'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:50 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:50 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:50 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" returned: 1 in 0.835s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Downloaded image 2c41a5f5-99c2-4a43-b21a-228f67138404 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c41a5f5-99c2-4a43-b21a-228f67138404', 'metadata': {}}])) to volume 4d3f0c87-8dad-4b39-966a-6e1cd40848c3 successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Temporary image 2c41a5f5-99c2-4a43-b21a-228f67138404 for user 898ebe2137154a6e9681236c2603fbc7 is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Marking volume 4d3f0c87-8dad-4b39-966a-6e1cd40848c3 as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Copying metadata from image 2c41a5f5-99c2-4a43-b21a-228f67138404 to 4d3f0c87-8dad-4b39-966a-6e1cd40848c3. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Creating volume glance metadata for volume 4d3f0c87-8dad-4b39-966a-6e1cd40848c3 backed by image 2c41a5f5-99c2-4a43-b21a-228f67138404 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2c41a5f5-99c2-4a43-b21a-228f67138404', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'be2c175b21a2053e345f22d6f416a988', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5085e333-c6e2-4d35-bd41-52ebe32e0cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3', 'volume_size': 1, 'image_id': '2c41a5f5-99c2-4a43-b21a-228f67138404', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c41a5f5-99c2-4a43-b21a-228f67138404', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be2c175b21a2053e345f22d6f416a988', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '934b178106e14b95a222b8d7a083f041', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08d6438dc861db95e6cd566f18000a2f4670f3f47f783c75666fe0c5c3529e11202aeb6cabb92643a735b4c7e9b2f84ee9e53bddcd819810df9bcc245dec322b', 'id': '2c41a5f5-99c2-4a43-b21a-228f67138404', 'created_at': datetime.datetime(2026, 7, 7, 13, 27, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c41a5f5-99c2-4a43-b21a-228f67138404/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5a2c54-c123-43f5-8ac1-858f7de7e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:50 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Volume volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 (4d3f0c87-8dad-4b39-966a-6e1cd40848c3): created successfully Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5a2c54-c123-43f5-8ac1-858f7de7e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:50 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Flow 'volume_create_manager' (771af734-ccee-46b8-9e93-b2fd50630de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ec690b50-d3ac-435e-ab4c-801feabd3d15 tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Created volume successfully. Jul 07 15:27:51 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5" returned: 0 in 0.720s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.502s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414033620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ef5d4-c9ef-40c1-95e6-3545a8e69a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef637ce201e44485aca067ead5d3339d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:40Z,use_quota=True,user_id='099d5b3dbf09461d9a397fdbfa283e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Creating volume f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:51 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:51 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 1073741824 Jul 07 15:27:51 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95750fb-bca6-4b2d-bfd8-e8072f193cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d9c830-df8c-4adc-ad82-8b371977c9f5', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4aa04b-2b38-4fc2-9efe-3adbc65bd4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:51 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 (94d9c830-df8c-4adc-ad82-8b371977c9f5): created successfully Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4aa04b-2b38-4fc2-9efe-3adbc65bd4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (bb9cd315-b480-41bd-b546-a44301362db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9daf74e9-2223-4853-803d-647f1027719f tempest-CreateVolumesFromSnapshotTest-925729344 None] Created volume successfully. Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Acquiring lock "cinder-4d3f0c87-8dad-4b39-966a-6e1cd40848c3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "cinder-4d3f0c87-8dad-4b39-966a-6e1cd40848c3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Acquiring lock "cinder-quobyte-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "cinder-quobyte-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" acquired by "delete_volume" :: waited 0.036s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5147a4-5dd4-4d04-802f-3ce91201ecd6]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:51 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.884s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Deleted volume successfully. Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-67d0e695-0f30-4407-9e45-a438193ad558 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-4cfd1497-c289-41d8-ae57-5ebae0ed2d00-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:51 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 Jul 07 15:27:51 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (4cbe97ea-73d1-4395-ba11-b5de2d2b9698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aed754-c7f3-4cda-8341-5203a2090b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7aed754-c7f3-4cda-8341-5203a2090b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828145585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6857b348-ca35-4c8d-8da8-d643b40e9063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:52Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaae9804-106a-4cbb-aa6f-42974e822159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaae9804-106a-4cbb-aa6f-42974e822159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b56c9-7c48-422c-9e35-d980cbd404f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b56c9-7c48-422c-9e35-d980cbd404f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6857b348-ca35-4c8d-8da8-d643b40e9063', 'volume_name': 'volume-6857b348-ca35-4c8d-8da8-d643b40e9063', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e0d06a-b04e-4fad-85e6-d16b46d2c987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e0d06a-b04e-4fad-85e6-d16b46d2c987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a901d6-8949-4fa9-94b0-a897e30738a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:51 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Volume 6857b348-ca35-4c8d-8da8-d643b40e9063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6857b348-ca35-4c8d-8da8-d643b40e9063', 'volume_size': 1} Jul 07 15:27:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:52 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 1073741824" returned: 0 in 1.096s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:52 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 Jul 07 15:27:52 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:52 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" returned: 0 in 0.791s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:52 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 Jul 07 15:27:52 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:52 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.910s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2037445753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13247e23-5ea1-46b0-8aa0-1d61314c9ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c827b952a04d24b826404b67a42b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:48Z,use_quota=True,user_id='ac00b664d72842a9b95f6284b505bb9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Creating volume 13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:52 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3eecc5-c391-473f-8949-ef42254ffd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:52 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 1073741824 Jul 07 15:27:52 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19795bfb-88a8-4143-993b-750ad0f95bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:52 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Volume volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 (f21ef5d4-c9ef-40c1-95e6-3545a8e69a87): created successfully Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19795bfb-88a8-4143-993b-750ad0f95bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Flow 'volume_create_manager' (b6483920-1c7c-4e7d-a3f3-bce8694ef2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:52 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a73168ee-6a34-40d5-8626-333675e85bff tempest-CreateVolumesFromSnapshotTest-925729344 None] Created volume successfully. Jul 07 15:27:53 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" returned: 1 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:53 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3 Jul 07 15:27:53 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:53 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:53 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" returned: 0 in 0.689s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 1073741824" returned: 0 in 0.881s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "cinder-quobyte-4d3f0c87-8dad-4b39-966a-6e1cd40848c3" released by "delete_volume" :: held 2.373s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:53 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 Jul 07 15:27:53 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[637e2cd7-5690-46d8-8adf-a0efb3453233]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Created reservations ['2fad7df4-ed1d-49ee-a307-6b0b7812b696', '9d7bd778-6894-44d0-8eae-8fdab43e0b34', 'f2a7bae4-220b-4077-9aef-e80e4fc5e88d', '2fb7b0c0-835d-43ea-9485-2ed1d0335646'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:53 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 Jul 07 15:27:53 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:53 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:53 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:54 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.706s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828145585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6857b348-ca35-4c8d-8da8-d643b40e9063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:27:52Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Creating volume 6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:27:54 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729b7485-1c7d-4bcb-ae97-682abca13511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:54 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 1073741824 Jul 07 15:27:54 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69280555-d487-455a-aa41-b18f17685f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:54 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Volume volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 (13247e23-5ea1-46b0-8aa0-1d61314c9ad4): created successfully Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69280555-d487-455a-aa41-b18f17685f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Flow 'volume_create_manager' (99f4d1ac-807e-4595-be1a-11bc1603929e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-533ff93d-6215-45b2-86fb-895339536b9c tempest-VolumeDependencyTests-211934958 None] Created volume successfully. Jul 07 15:27:54 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.697s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:54 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Deleted volume successfully. Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87" returned: 0 in 0.831s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:54 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87 Jul 07 15:27:54 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bbdd8ce3-5d4a-499e-8509-e27085f60a7f tempest-VolumeAndVolumeTypeFromImageTest-930594550 None] Lock "cinder-4d3f0c87-8dad-4b39-966a-6e1cd40848c3-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:55 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87" returned: 0 in 0.773s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87" released by "delete_volume" :: held 1.670s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Created reservations ['ce29b841-5ce6-4799-ac51-ca77be02315c', 'f6ff11a6-3d00-4d0e-8ec9-5c573beb7e07', '8abb9880-b1d5-4b42-9260-69cc2d5f6df9', '3c208318-be03-451f-a497-36de4034a988'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:55 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 1073741824" returned: 0 in 1.109s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:55 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 Jul 07 15:27:55 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:55 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:55 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-94d9c830-df8c-4adc-ad82-8b371977c9f5-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-94d9c830-df8c-4adc-ad82-8b371977c9f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-94d9c830-df8c-4adc-ad82-8b371977c9f5" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-94d9c830-df8c-4adc-ad82-8b371977c9f5" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[43520960-f575-442c-9ecb-039c400b0159]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:56 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 Jul 07 15:27:56 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:56 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.750s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Deleted volume successfully. Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d76780f5-f17f-43f3-b8c2-ba26ae01b799 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-f21ef5d4-c9ef-40c1-95e6-3545a8e69a87-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:56 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063" returned: 0 in 0.869s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.980s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a901d6-8949-4fa9-94b0-a897e30738a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6857b348-ca35-4c8d-8da8-d643b40e9063', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a71eee6-b03a-4aa6-8352-1104f66473fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Creating offline snapshot eecbf808-9560-43d2-b581-62074a062394 of volume 13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:27:56 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Volume volume-6857b348-ca35-4c8d-8da8-d643b40e9063 (6857b348-ca35-4c8d-8da8-d643b40e9063): created successfully Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a71eee6-b03a-4aa6-8352-1104f66473fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (4cbe97ea-73d1-4395-ba11-b5de2d2b9698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a945db-c8f7-472c-9762-354f095a035f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ea39244a-57c1-4521-a22a-e5612d3a85a1 tempest-ProjectReaderTests-1961743153 None] Created volume successfully. Jul 07 15:27:56 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 Jul 07 15:27:56 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:57 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5" returned: 0 in 0.918s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:57 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5 Jul 07 15:27:57 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:57 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" returned: 0 in 0.937s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:57 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 1G Jul 07 15:27:57 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:57 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-94d9c830-df8c-4adc-ad82-8b371977c9f5" returned: 0 in 0.764s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-94d9c830-df8c-4adc-ad82-8b371977c9f5" released by "delete_volume" :: held 1.743s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Created reservations ['b14ac9eb-71ff-4e05-83a6-c89bbc7041e1', 'e19e8916-3568-4d97-8f06-0cafb1b4aa70', '94421288-512b-4d57-8236-331170192164', '595df2d9-8460-4e26-8ce8-a419010332c5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:27:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:57 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:27:57 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c02f403-fd7d-4788-92ca-e818e93353b3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:58 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 1G" returned: 0 in 1.011s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:58 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 Jul 07 15:27:58 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:58 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 Jul 07 15:27:58 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:58 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.829s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:27:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Deleted volume successfully. Jul 07 15:27:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-facf08ca-303c-483a-a8ec-ed1998524b2f tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-94d9c830-df8c-4adc-ad82-8b371977c9f5-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:27:59 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:59 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8" returned: 0 in 0.886s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394" returned: 0 in 0.799s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:27:59 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 is being set with open permissions: ugo+rw Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:27:59 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8 Jul 07 15:27:59 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:59 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 Jul 07 15:27:59 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Flow 'volume_create_manager' (1f648864-7225-4a28-89c0-b3e6838d8a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4202f5-5260-48c6-a9d5-10f316b8b936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4202f5-5260-48c6-a9d5-10f316b8b936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c370b1bc-6ed6-4936-8b9d-e91b0802bbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f7ab0a43f14f34987ccbd8b470e0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:00Z,use_quota=True,user_id='1f406f1940da45da908f0c88572498c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de8ab3f-a4d4-4e0a-bd9a-ff805d9626a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de8ab3f-a4d4-4e0a-bd9a-ff805d9626a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4649f9b8-a118-455f-b413-0b7fd660f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4649f9b8-a118-455f-b413-0b7fd660f352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c370b1bc-6ed6-4936-8b9d-e91b0802bbe8', 'volume_name': 'volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8ad564-2faf-428a-8c63-b46cbd5cabda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8ad564-2faf-428a-8c63-b46cbd5cabda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585b7e24-1730-4ff2-a447-623ffae541dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:27:59 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Volume c370b1bc-6ed6-4936-8b9d-e91b0802bbe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8', 'volume_size': 1} Jul 07 15:27:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:27:59 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8" returned: 0 in 0.710s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8" released by "delete_volume" :: held 1.653s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:00 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394" returned: 0 in 0.722s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Created reservations ['8c371154-79fc-4bcb-9987-b37f77a76aef', '8a613b9d-a2e0-423d-8cfc-2282d86484f5', 'c7dc41b3-09fd-45de-b010-70e877f4abfb', '0395047c-f545-44af-8c02-abfc1103f496'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:00 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.info Jul 07 15:28:00 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:00 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:00 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-383b5c75-190e-4774-bba6-dc39bb440f74-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-383b5c75-190e-4774-bba6-dc39bb440f74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-383b5c75-190e-4774-bba6-dc39bb440f74" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-383b5c75-190e-4774-bba6-dc39bb440f74" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b49530-c0e5-45bd-858f-f047d11f41b0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:00 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 Jul 07 15:28:00 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:00 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.info" returned: 0 in 0.708s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:00 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.info is being set with open permissions: ugo+rw Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:00 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.info Jul 07 15:28:00 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:00 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.701s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:00 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Deleted volume successfully. Jul 07 15:28:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-0901cea6-0834-467e-95c9-302719d4841e tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-7fbc97c0-c2cc-4108-94ab-a8ce9f41ced8-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:01 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.info" returned: 0 in 0.660s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:01 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.961s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.248s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74" returned: 0 in 0.836s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:01 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74 Jul 07 15:28:01 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Creating offline snapshot 896b5f47-7a88-4371-9545-4a9b41501e94 of volume 6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:28:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6cee9f85-89d9-477f-9a3d-f13b4049444b tempest-VolumeDependencyTests-211934958 None] Create snapshot completed successfully Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dacd4fd-e4cc-4691-8e7b-1e898d70acc0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:01 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 Jul 07 15:28:01 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:02 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-383b5c75-190e-4774-bba6-dc39bb440f74" returned: 0 in 0.723s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-383b5c75-190e-4774-bba6-dc39bb440f74" released by "delete_volume" :: held 1.604s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Created reservations ['c317b964-5c15-468b-b61f-b02b2aaf8d86', '4949e2a6-0d3b-4ba2-a5e1-63cee87e992f', '5b91cf2a-58b6-4bae-9baf-abb1ef4aff83', '89539a3f-c944-4f80-ab25-339a1bcd3e75'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Flow 'volume_create_manager' (8afc7b91-b79e-4215-83d6-719732305f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:02 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e176aced-3415-479f-8f47-58ec994b1e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063" returned: 0 in 0.823s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:02 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 1G Jul 07 15:28:02 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e176aced-3415-479f-8f47-58ec994b1e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1072867135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c522acd-bf73-4e5d-8517-0d7ef1187ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c827b952a04d24b826404b67a42b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eecbf808-9560-43d2-b581-62074a062394,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:02Z,use_quota=True,user_id='ac00b664d72842a9b95f6284b505bb9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527ecfb3-3fd5-4b90-b8af-196c528edb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527ecfb3-3fd5-4b90-b8af-196c528edb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb14595-4db0-4150-aeac-c0f803042cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb14595-4db0-4150-aeac-c0f803042cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c522acd-bf73-4e5d-8517-0d7ef1187ee0', 'volume_name': 'volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0', 'volume_size': 1, 'snapshot_id': 'eecbf808-9560-43d2-b581-62074a062394'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f269a818-292b-4bc3-a675-5b7e31a94d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f269a818-292b-4bc3-a675-5b7e31a94d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6184fb1-455e-4089-aafe-9ae5d231bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:02 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Volume 1c522acd-bf73-4e5d-8517-0d7ef1187ee0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0', 'volume_size': 1, 'snapshot_id': 'eecbf808-9560-43d2-b581-62074a062394'} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:02 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:02 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-9cd68e46-1b54-4fe1-81ba-c928c5d655fc-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-9cd68e46-1b54-4fe1-81ba-c928c5d655fc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-9cd68e46-1b54-4fe1-81ba-c928c5d655fc" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-9cd68e46-1b54-4fe1-81ba-c928c5d655fc" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424a0d2-45df-4bba-bfb0-898d25de6593]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:03 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc Jul 07 15:28:03 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:03 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.714s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Deleted volume successfully. Jul 07 15:28:03 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 1G" returned: 0 in 0.840s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6857b348-ca35-4c8d-8da8-d643b40e9063 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:03 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6857b348-ca35-4c8d-8da8-d643b40e9063 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 Jul 07 15:28:03 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-c8d39629-f328-40d1-9ed6-48730314cf96 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-383b5c75-190e-4774-bba6-dc39bb440f74-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:03 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc" returned: 0 in 0.807s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:03 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc Jul 07 15:28:03 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:03 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6857b348-ca35-4c8d-8da8-d643b40e9063 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94" returned: 0 in 0.691s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:03 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 is being set with open permissions: ugo+rw Jul 07 15:28:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:03 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 Jul 07 15:28:03 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:04 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9cd68e46-1b54-4fe1-81ba-c928c5d655fc" returned: 0 in 0.658s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-9cd68e46-1b54-4fe1-81ba-c928c5d655fc" released by "delete_volume" :: held 1.516s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Created reservations ['197a1a80-c599-4f8f-9aa4-a27d78e74fbd', 'af858f4c-064d-4f75-838d-f3b10a2ed2ff', '6b91aed4-f9d2-4ce1-b7bd-4387e6a0f20a', '2ec51efe-4af5-4451-815d-0daf3a953f61'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:04 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:04 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:04 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94" returned: 0 in 0.632s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:04 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.info Jul 07 15:28:04 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-68112303-2866-4ed0-a037-65ab3a67f11c-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-68112303-2866-4ed0-a037-65ab3a67f11c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-68112303-2866-4ed0-a037-65ab3a67f11c" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-68112303-2866-4ed0-a037-65ab3a67f11c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Deleting offline snapshot 68112303-2866-4ed0-a037-65ab3a67f11c of volume f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] snapshot_file for this snap is: volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5739b8c0-37d1-4dba-b3b4-404ee49958a0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:05 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.680s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Deleted volume successfully. Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e23d6e96-7504-4dcc-931b-685acc6268bf tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-9cd68e46-1b54-4fe1-81ba-c928c5d655fc-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:05 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c Jul 07 15:28:05 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:05 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.info" returned: 0 in 0.684s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:05 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.info is being set with open permissions: ugo+rw Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:05 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.info Jul 07 15:28:05 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:05 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:28:05 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.info" returned: 0 in 0.667s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.450s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a5a31c-2bdc-4b5e-bb53-0b9f5df3c654]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.013s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c370b1bc-6ed6-4936-8b9d-e91b0802bbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f7ab0a43f14f34987ccbd8b470e0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:00Z,use_quota=True,user_id='1f406f1940da45da908f0c88572498c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Creating volume c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:05 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:05 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 1073741824 Jul 07 15:28:05 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:05 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-56b861a9-97a9-4a1f-b234-a6a8871cc7f9 tempest-ProjectReaderTests-1961743153 None] Create snapshot completed successfully Jul 07 15:28:06 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 Jul 07 15:28:06 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-896b5f47-7a88-4371-9545-4a9b41501e94-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-896b5f47-7a88-4371-9545-4a9b41501e94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-6857b348-ca35-4c8d-8da8-d643b40e9063" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-6857b348-ca35-4c8d-8da8-d643b40e9063" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-896b5f47-7a88-4371-9545-4a9b41501e94" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-896b5f47-7a88-4371-9545-4a9b41501e94" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Deleting offline snapshot 896b5f47-7a88-4371-9545-4a9b41501e94 of volume 6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] snapshot_file for this snap is: volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b358e7-3e72-476e-899b-4a0abb180bdc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:06 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" returned: 0 in 0.801s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:06 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c Jul 07 15:28:06 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:06 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 Jul 07 15:28:06 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:06 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 1073741824" returned: 0 in 0.894s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:06 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 Jul 07 15:28:06 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:07 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94" returned: 0 in 0.786s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6857b348-ca35-4c8d-8da8-d643b40e9063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3802d37-962d-4204-904c-f5add6134787]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:07 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8" returned: 0 in 0.673s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.093s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-quobyte-eecbf808-9560-43d2-b581-62074a062394-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-eecbf808-9560-43d2-b581-62074a062394-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Creating volume 1c522acd-bf73-4e5d-8517-0d7ef1187ee0 from snapshot eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:07 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-quobyte-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585b7e24-1730-4ff2-a447-623ffae541dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57163e5-46a2-443d-b9fe-62a8b080040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c" returned: 0 in 0.847s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] snapshot: eecbf808-9560-43d2-b581-62074a062394, volume: 1c522acd-bf73-4e5d-8517-0d7ef1187ee0, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:28:07 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Volume volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 (c370b1bc-6ed6-4936-8b9d-e91b0802bbe8): created successfully Jul 07 15:28:07 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c Jul 07 15:28:07 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57163e5-46a2-443d-b9fe-62a8b080040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Flow 'volume_create_manager' (1f648864-7225-4a28-89c0-b3e6838d8a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:07 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 Jul 07 15:28:07 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:07 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d822d4e6-3d82-4962-b4a8-1332a8dd4848 tempest-CinderUnicodeTest-476715153 None] Created volume successfully. Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[977384fd-aa8b-4027-aae4-43d071695764]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:07 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 Jul 07 15:28:07 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:08 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3.68112303-2866-4ed0-a037-65ab3a67f11c" returned: 0 in 0.706s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-68112303-2866-4ed0-a037-65ab3a67f11c" released by "_delete_snapshot" :: held 3.291s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" released by "delete_snapshot" :: held 3.314s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:08 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063" returned: 0 in 0.863s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:08 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 Jul 07 15:28:08 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Created reservations ['e2909f8e-2e02-4623-aa28-ffb55ad85b95', '56bfcee0-955f-43b8-96ca-ac6e45d45867', '20a0c630-5164-43b8-921a-103d2d2f2d90', '0717e42c-cdc4-47d9-997e-0540c52bf0f6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:08 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82e267f-96f1-4d69-bef8-5c32785236a4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:08 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Delete snapshot completed successfully. Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f89fff5e-7109-44f3-be1b-d521fe346ba2 tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-68112303-2866-4ed0-a037-65ab3a67f11c-delete_snapshot" released by "delete_snapshot" :: held 3.542s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:08 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 Jul 07 15:28:08 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Flow 'volume_create_manager' (2a441bfc-4aaf-404e-8ab1-da2cbbab9087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d87e0bd-92bb-4f7e-8bc2-29d559a2d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d87e0bd-92bb-4f7e-8bc2-29d559a2d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-519637726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012f80fd-fe80-49c1-9b39-dbfb02e9661e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f7ab0a43f14f34987ccbd8b470e0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:09Z,use_quota=True,user_id='1f406f1940da45da908f0c88572498c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad9b8fa-10b7-4b34-a5ea-345a6be92855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad9b8fa-10b7-4b34-a5ea-345a6be92855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82746e9-5b71-4b30-9e99-12e722480bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82746e9-5b71-4b30-9e99-12e722480bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012f80fd-fe80-49c1-9b39-dbfb02e9661e', 'volume_name': 'volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2fcf2c-1332-469f-b9b3-c26c8c015e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2fcf2c-1332-469f-b9b3-c26c8c015e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac5b7fd-96b9-4f2f-8f85-3d2cb1ceaf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:08 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Volume 012f80fd-fe80-49c1-9b39-dbfb02e9661e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e', 'volume_size': 1} Jul 07 15:28:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "cinder-quobyte-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:09 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94" returned: 0 in 0.935s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" acquired by "delete_volume" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:09 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94 Jul 07 15:28:09 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad5b752-0ac2-4dcb-9c5c-863cfd2bf99f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:09 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" returned: 0 in 0.889s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:09 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 Jul 07 15:28:09 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:09 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 Jul 07 15:28:09 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:09 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063.896b5f47-7a88-4371-9545-4a9b41501e94" returned: 0 in 0.688s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-896b5f47-7a88-4371-9545-4a9b41501e94" released by "_delete_snapshot" :: held 3.376s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-6857b348-ca35-4c8d-8da8-d643b40e9063" released by "delete_snapshot" :: held 3.401s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:10 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Created reservations ['1cd0bfba-dbc7-414c-af9c-98f122deb289', 'fe72db62-bf7d-4458-8492-84b423ef10f1', '2ac8b218-af2e-4f67-9b53-6b35d38a909e', '4bd3e18b-ff3e-4d69-a7f4-7a38b70da8e6'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Delete snapshot completed successfully. Jul 07 15:28:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5ab9bd17-7602-4bfa-97a4-8b19e93a92c0 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-896b5f47-7a88-4371-9545-4a9b41501e94-delete_snapshot" released by "delete_snapshot" :: held 3.551s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:10 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" returned: 0 in 0.848s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:10 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3 Jul 07 15:28:10 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-6857b348-ca35-4c8d-8da8-d643b40e9063-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-6857b348-ca35-4c8d-8da8-d643b40e9063-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-6857b348-ca35-4c8d-8da8-d643b40e9063" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-6857b348-ca35-4c8d-8da8-d643b40e9063" acquired by "delete_volume" :: waited 0.041s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b686727-f328-4c41-a1bb-7c3cd7cf9d04]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:11 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" returned: 0 in 1.278s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-quobyte-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3" released by "delete_volume" :: held 2.245s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:11 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 Jul 07 15:28:11 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Created reservations ['8a6d259f-dfc9-4802-9854-eeb8c12962cf', 'cf03880a-2c6d-46cc-9d06-676da006e580', '6b83179e-366d-4529-97e5-b22acb49e768', 'a8a099bd-2a10-4ff4-8297-ad8d116943e3'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:12 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:12 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:13 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.407s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:13 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:13 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Deleted volume successfully. Jul 07 15:28:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030f7a6c-9547-49b2-a600-d613fee7ca2d tempest-CreateVolumesFromSnapshotTest-925729344 None] Lock "cinder-f7e6d0ff-73eb-4409-aa71-d701af5f5eb3-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:13 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063" returned: 0 in 2.444s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:13 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063 Jul 07 15:28:13 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:15 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-6857b348-ca35-4c8d-8da8-d643b40e9063" returned: 0 in 1.343s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-6857b348-ca35-4c8d-8da8-d643b40e9063" released by "delete_volume" :: held 3.931s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=132,cinder:UPDATE=168,cinder:INSERT=48,cinder:DELETE=18 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=188,cinder:SELECT=141,cinder:DELETE=15,cinder:INSERT=50 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Created reservations ['3e143c2a-0a27-49f3-8f87-f79b4ea1cdc4', '77e839d6-9ac4-4874-9fcf-07907f6e8741', 'f66de12f-f087-4781-8c7f-53eecc2fc6a1', '10078621-2f96-4705-921b-7377cb6357e1'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:15 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" returned: 0 in 5.869s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[07adaa70-9e8d-45c8-8dd7-6a73f665c58e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:15 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:15 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:15 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 Jul 07 15:28:15 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:16 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.919s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:16 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Deleted volume successfully. Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (cd21787d-0c54-4f51-a6ea-698e6d11bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9fb5fc-f446-4fc8-8633-a9434285afae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a59428e8-383c-42ad-9e7a-938461cd67a5 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-6857b348-ca35-4c8d-8da8-d643b40e9063-delete_volume" released by "delete_volume" :: held 5.252s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9fb5fc-f446-4fc8-8633-a9434285afae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951917148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5f4dcb-323f-44f0-a17b-fac1f36834e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:16Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484342cd-4c49-4f8e-8d23-bf28950d0f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484342cd-4c49-4f8e-8d23-bf28950d0f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66f85ac-5937-41c3-aa8f-343cf53a92d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66f85ac-5937-41c3-aa8f-343cf53a92d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5f4dcb-323f-44f0-a17b-fac1f36834e9', 'volume_name': 'volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383fc183-c765-4183-bbc8-0a3d2934e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383fc183-c765-4183-bbc8-0a3d2934e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc95dda-e5ea-4438-bd11-6cb382aeeb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:16 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Volume fd5f4dcb-323f-44f0-a17b-fac1f36834e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9', 'volume_size': 1} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:16 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" returned: 0 in 1.140s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:28:16 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Converted 1024.00 MB image at 174.45 MB/s Jul 07 15:28:16 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 is being set with open permissions: ugo+rw Jul 07 15:28:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:16 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 Jul 07 15:28:16 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:17 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" returned: 0 in 0.655s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" released by "_copy_volume_from_snapshot" :: held 9.501s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-eecbf808-9560-43d2-b581-62074a062394-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" released by "_create_volume_from_snapshot" :: held 9.568s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.587s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.124s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-519637726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012f80fd-fe80-49c1-9b39-dbfb02e9661e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f7ab0a43f14f34987ccbd8b470e0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:09Z,use_quota=True,user_id='1f406f1940da45da908f0c88572498c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Creating volume 012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:17 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:17 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e 1073741824 Jul 07 15:28:17 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6184fb1-455e-4089-aafe-9ae5d231bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0', 'volume_size': 1, 'snapshot_id': 'eecbf808-9560-43d2-b581-62074a062394'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9867a5b-a8e2-4d1a-b914-1883f9c23c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:17 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Volume volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 (1c522acd-bf73-4e5d-8517-0d7ef1187ee0): created successfully Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9867a5b-a8e2-4d1a-b914-1883f9c23c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Flow 'volume_create_manager' (8afc7b91-b79e-4215-83d6-719732305f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:17 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6c839197-d03f-417b-bdf7-b450dfddf0ff tempest-VolumeDependencyTests-211934958 None] Created volume successfully. Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (b16bc3ea-d560-4f1b-9b92-130091653eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d06c3a2-92df-4177-8d8c-61cc9e757e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d06c3a2-92df-4177-8d8c-61cc9e757e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-924866509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a65117-61e2-4048-8a78-ca2571677890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:17Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6768064a-c825-46bb-9d71-f75866518fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6768064a-c825-46bb-9d71-f75866518fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862793b5-80a0-45e9-80d7-9cd463d7f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862793b5-80a0-45e9-80d7-9cd463d7f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a65117-61e2-4048-8a78-ca2571677890', 'volume_name': 'volume-f7a65117-61e2-4048-8a78-ca2571677890', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d9758-ea2f-41af-acfc-61624621e3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d9758-ea2f-41af-acfc-61624621e3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c31a7eb-6455-4a11-a7c0-068dd892e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:17 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume f7a65117-61e2-4048-8a78-ca2571677890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a65117-61e2-4048-8a78-ca2571677890', 'volume_size': 1} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-eecbf808-9560-43d2-b581-62074a062394-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Lock "cinder-eecbf808-9560-43d2-b581-62074a062394-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-quobyte-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-quobyte-eecbf808-9560-43d2-b581-62074a062394" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-eecbf808-9560-43d2-b581-62074a062394" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Deleting offline snapshot eecbf808-9560-43d2-b581-62074a062394 of volume 13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] snapshot_file for this snap is: volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888ba03-11c5-4d53-a749-2fc6874fd4aa]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:17 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 Jul 07 15:28:17 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:18 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e 1073741824" returned: 0 in 0.940s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:18 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e Jul 07 15:28:18 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:18 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394" returned: 0 in 0.825s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc9cd9-2c1f-4de4-a9f2-7da142cef887]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:18 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 Jul 07 15:28:18 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:18 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e" returned: 0 in 0.668s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951917148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5f4dcb-323f-44f0-a17b-fac1f36834e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:16Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Creating volume fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:18 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:18 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 1073741824 Jul 07 15:28:18 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac5b7fd-96b9-4f2f-8f85-3d2cb1ceaf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83ea48-4616-4b2f-b451-c5cea9d08ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:18 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Volume volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e (012f80fd-fe80-49c1-9b39-dbfb02e9661e): created successfully Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83ea48-4616-4b2f-b451-c5cea9d08ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Flow 'volume_create_manager' (2a441bfc-4aaf-404e-8ab1-da2cbbab9087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-df5639da-44b1-4f5b-a7b5-0fd7948411cb tempest-CinderUnicodeTest-476715153 None] Created volume successfully. Jul 07 15:28:19 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" returned: 0 in 0.769s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:19 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 Jul 07 15:28:19 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:19 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 1073741824" returned: 0 in 0.872s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:19 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 Jul 07 15:28:19 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:20 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394" returned: 0 in 0.876s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:20 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394 Jul 07 15:28:20 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:20 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" returned: 0 in 0.688s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-924866509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a65117-61e2-4048-8a78-ca2571677890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:17Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Creating volume f7a65117-61e2-4048-8a78-ca2571677890 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:20 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc95dda-e5ea-4438-bd11-6cb382aeeb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b924f-f4b5-4e61-8945-9af40808515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:20 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 1073741824 Jul 07 15:28:20 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:20 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Volume volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 (fd5f4dcb-323f-44f0-a17b-fac1f36834e9): created successfully Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4b924f-f4b5-4e61-8945-9af40808515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (cd21787d-0c54-4f51-a6ea-698e6d11bc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:20 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-218d6ab9-7309-4683-b6c7-5e49d054b234 tempest-ProjectReaderTests-1961743153 None] Created volume successfully. Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:20 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4.eecbf808-9560-43d2-b581-62074a062394" returned: 0 in 0.727s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-eecbf808-9560-43d2-b581-62074a062394" released by "_delete_snapshot" :: held 3.302s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" released by "delete_snapshot" :: held 3.331s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Created reservations ['85ccf505-d962-4cdb-ab18-1dcbe3e34b42', 'f61c53ef-1478-4f5f-9c1c-1bd316075f78', 'abd7f185-704f-4b27-953f-9e70566858ef', '7a19c531-66e7-4b81-b0c8-c736b6a800e0'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:21 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Delete snapshot completed successfully. Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-35c446c8-ca1a-4d5f-aa61-e6afa725894c tempest-VolumeDependencyTests-211934958 None] Lock "cinder-eecbf808-9560-43d2-b581-62074a062394-delete_snapshot" released by "delete_snapshot" :: held 3.461s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:21 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 1073741824" returned: 0 in 0.880s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:21 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 Jul 07 15:28:21 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-13247e23-5ea1-46b0-8aa0-1d61314c9ad4-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Lock "cinder-13247e23-5ea1-46b0-8aa0-1d61314c9ad4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-quobyte-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92172f5a-c247-49e1-8d5e-3afce32580f0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:21 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890" returned: 0 in 0.677s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.821s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c31a7eb-6455-4a11-a7c0-068dd892e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a65117-61e2-4048-8a78-ca2571677890', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ba437d-d247-4272-9c71-c81f5a6fc330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Creating offline snapshot 73985737-13ca-41b4-a59b-beee485c1599 of volume 012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:28:22 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume volume-f7a65117-61e2-4048-8a78-ca2571677890 (f7a65117-61e2-4048-8a78-ca2571677890): created successfully Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ba437d-d247-4272-9c71-c81f5a6fc330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (b16bc3ea-d560-4f1b-9b92-130091653eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10392f1-af2a-4fde-8e5f-f78b18b5c2f4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:22 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-0b730000-4bad-476d-8def-61a30cf9de82 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created volume successfully. Jul 07 15:28:22 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 Jul 07 15:28:22 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:22 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e Jul 07 15:28:22 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:22 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" returned: 0 in 0.765s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:22 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4 Jul 07 15:28:22 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:22 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e" returned: 0 in 0.781s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:22 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 1G Jul 07 15:28:22 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (b6cbd9d1-7a08-42f8-b489-311e9cd8a514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a02009-6ccd-4d95-8d3d-b36d7474f0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a02009-6ccd-4d95-8d3d-b36d7474f0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47838932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7073a2f0-d478-4137-ba68-8a897cc2b345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:23Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194af485-f7c3-4af6-b8d4-ec6f75e6ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194af485-f7c3-4af6-b8d4-ec6f75e6ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c811c6-1db4-41eb-88e6-ee71d60f7ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c811c6-1db4-41eb-88e6-ee71d60f7ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7073a2f0-d478-4137-ba68-8a897cc2b345', 'volume_name': 'volume-7073a2f0-d478-4137-ba68-8a897cc2b345', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e027854-4748-4251-a13b-319121fc6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e027854-4748-4251-a13b-319121fc6529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26351190-aa45-45f0-bb89-27a85c48dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume 7073a2f0-d478-4137-ba68-8a897cc2b345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7073a2f0-d478-4137-ba68-8a897cc2b345', 'volume_size': 1} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:23 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" returned: 0 in 0.814s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-13247e23-5ea1-46b0-8aa0-1d61314c9ad4" released by "delete_volume" :: held 1.650s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (b0399b7b-2206-4d67-be1c-f3d5c769f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f90d349-3739-4d8c-8a6b-706fc8d7d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f90d349-3739-4d8c-8a6b-706fc8d7d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098840816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6b1689-cde9-43e8-8092-289af039691f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:24Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0ed840-7522-4729-9d5f-21b8fda21bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0ed840-7522-4729-9d5f-21b8fda21bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65b3c70-fa42-4478-82d7-dfb6a9479285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65b3c70-fa42-4478-82d7-dfb6a9479285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6b1689-cde9-43e8-8092-289af039691f', 'volume_name': 'volume-ba6b1689-cde9-43e8-8092-289af039691f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bae71f-7235-4ff5-b73c-d359dc739745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bae71f-7235-4ff5-b73c-d359dc739745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc859b4-4ace-4bd5-a0b8-d3ca942fc170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume ba6b1689-cde9-43e8-8092-289af039691f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6b1689-cde9-43e8-8092-289af039691f', 'volume_size': 1} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Created reservations ['5632845c-b8ec-4d89-8270-1d739857ee2d', 'b3588a23-7076-4771-8333-d641f6dfd944', '1f4ad175-e281-46b2-b091-b9891b29c685', '6f13d0dc-3deb-4322-b457-2ec0b2b3f323'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:23 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 1G" returned: 0 in 0.990s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:23 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 Jul 07 15:28:23 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:23 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:23 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (f4b99116-1a8b-4428-8b28-b6dec35f3939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dbbe3e-d25e-4467-b47a-0014a1ae6da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dbbe3e-d25e-4467-b47a-0014a1ae6da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580530220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072f5685-542c-4eb9-9733-2607bb184dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:24Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfc79f1-e999-4930-b651-478de2107cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfc79f1-e999-4930-b651-478de2107cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74bbad5-2bb8-4077-8b1d-6d2d79f7ed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74bbad5-2bb8-4077-8b1d-6d2d79f7ed86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072f5685-542c-4eb9-9733-2607bb184dd2', 'volume_name': 'volume-072f5685-542c-4eb9-9733-2607bb184dd2', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1a49a-349d-4a30-b5a1-9107c98767cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1a49a-349d-4a30-b5a1-9107c98767cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d83ef-b5eb-47e2-908e-6bffb3e6fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume 072f5685-542c-4eb9-9733-2607bb184dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072f5685-542c-4eb9-9733-2607bb184dd2', 'volume_size': 1} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-1c522acd-bf73-4e5d-8517-0d7ef1187ee0-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Lock "cinder-1c522acd-bf73-4e5d-8517-0d7ef1187ee0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Acquiring lock "cinder-quobyte-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd7b5c-184d-4fa2-864b-9e6d54d7dc56]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:24 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 Jul 07 15:28:24 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (9ac69bff-78ea-46f4-b642-5421cb06cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a389a4c-3e3a-4252-860e-8025a18d715e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a389a4c-3e3a-4252-860e-8025a18d715e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-923660058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2057acd6-d60d-4955-aa31-177e7e2ce528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:24Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a780b457-2d71-4273-a5e7-19c35f4d3d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a780b457-2d71-4273-a5e7-19c35f4d3d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251a9e5e-e691-49d5-b10a-b34e08f92d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251a9e5e-e691-49d5-b10a-b34e08f92d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2057acd6-d60d-4955-aa31-177e7e2ce528', 'volume_name': 'volume-2057acd6-d60d-4955-aa31-177e7e2ce528', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33d916-e5e3-4e9e-852b-c4e308a425ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33d916-e5e3-4e9e-852b-c4e308a425ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067310fb-8918-4db0-967d-b9ca97e6acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume 2057acd6-d60d-4955-aa31-177e7e2ce528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2057acd6-d60d-4955-aa31-177e7e2ce528', 'volume_size': 1} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:24 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599" returned: 0 in 0.948s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:24 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 is being set with open permissions: ugo+rw Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:24 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.903s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Deleted volume successfully. Jul 07 15:28:24 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 Jul 07 15:28:24 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b4886d5f-9017-47c3-b0e3-1cc1e70ffa2f tempest-VolumeDependencyTests-211934958 None] Lock "cinder-13247e23-5ea1-46b0-8aa0-1d61314c9ad4-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (da47451b-95be-4af8-b3e3-9db220ef4bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb336824-afb0-482b-ba59-cc8e8a1ffadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb336824-afb0-482b-ba59-cc8e8a1ffadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1677586945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e15c6c4-459e-4e0b-8475-0e36416372d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:25Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643b2299-e601-48e3-ac33-1da465b6f589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643b2299-e601-48e3-ac33-1da465b6f589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082a3810-852e-4af2-a9c4-63b7816c0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082a3810-852e-4af2-a9c4-63b7816c0c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e15c6c4-459e-4e0b-8475-0e36416372d2', 'volume_name': 'volume-4e15c6c4-459e-4e0b-8475-0e36416372d2', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29229800-e5d8-41b6-8e6c-9859cc2cc2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29229800-e5d8-41b6-8e6c-9859cc2cc2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ca47f1-129d-459e-9e47-cd9a28e19aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:25 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume 4e15c6c4-459e-4e0b-8475-0e36416372d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e15c6c4-459e-4e0b-8475-0e36416372d2', 'volume_size': 1} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:25 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" returned: 0 in 1.043s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:25 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0 Jul 07 15:28:25 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:25 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599" returned: 0 in 0.720s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:25 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.info Jul 07 15:28:25 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:26 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Lock "cinder-quobyte-1c522acd-bf73-4e5d-8517-0d7ef1187ee0" released by "delete_volume" :: held 1.789s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Created reservations ['fc95a433-7304-4a53-891c-dc84e5eac599', '289361d5-c05c-43e7-8461-622de375bafd', 'eac3d6a2-3429-49a3-8023-426ce69d9f11', 'd6e58454-cd00-4d19-b566-8ee80e037b4a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:26 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:26 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:26 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.info" returned: 0 in 0.667s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:26 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.info is being set with open permissions: ugo+rw Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:26 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.info Jul 07 15:28:26 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:26 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.667s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Deleted volume successfully. Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d2e0bd2a-5400-481e-a29a-6f324e4011fe tempest-VolumeDependencyTests-211934958 None] Lock "cinder-1c522acd-bf73-4e5d-8517-0d7ef1187ee0-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:26 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.info" returned: 0 in 0.674s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.899s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.041s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Creating offline snapshot 015f6e79-f830-4ca1-ae8a-d11d3f19efd8 of volume fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:28:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-cf8efbf0-4092-45b5-b80a-bde1415a9e1c tempest-CinderUnicodeTest-476715153 None] Create snapshot completed successfully Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff195d-e670-47be-8168-ac251958560a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:27 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 Jul 07 15:28:27 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Acquiring lock "cinder-73985737-13ca-41b4-a59b-beee485c1599-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Lock "cinder-73985737-13ca-41b4-a59b-beee485c1599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Acquiring lock "cinder-quobyte-012f80fd-fe80-49c1-9b39-dbfb02e9661e" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-012f80fd-fe80-49c1-9b39-dbfb02e9661e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Acquiring lock "cinder-quobyte-73985737-13ca-41b4-a59b-beee485c1599" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-73985737-13ca-41b4-a59b-beee485c1599" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Deleting offline snapshot 73985737-13ca-41b4-a59b-beee485c1599 of volume 012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] snapshot_file for this snap is: volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5c649b-abda-4eef-ab40-6e9f95b9d7de]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:27 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 Jul 07 15:28:27 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:27 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" returned: 0 in 0.854s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:27 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 1G Jul 07 15:28:27 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:28 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599" returned: 0 in 0.873s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:28:28 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf16968-7339-460b-b336-84e7bb607a84]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:28 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e Jul 07 15:28:28 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:28 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 1G" returned: 0 in 0.913s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:28 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 Jul 07 15:28:28 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:29 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e" returned: 0 in 0.810s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:29 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 Jul 07 15:28:29 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:29 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8" returned: 0 in 0.752s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:29 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 is being set with open permissions: ugo+rw Jul 07 15:28:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:29 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 Jul 07 15:28:29 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:30 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599" returned: 0 in 0.772s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:30 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8" returned: 0 in 0.671s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:30 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599 Jul 07 15:28:30 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:30 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.info Jul 07 15:28:30 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:30 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e.73985737-13ca-41b4-a59b-beee485c1599" returned: 0 in 0.664s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:30 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-73985737-13ca-41b4-a59b-beee485c1599" released by "_delete_snapshot" :: held 3.262s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.info" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:30 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.info is being set with open permissions: ugo+rw Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-012f80fd-fe80-49c1-9b39-dbfb02e9661e" released by "delete_snapshot" :: held 3.298s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:30 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.info Jul 07 15:28:30 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Created reservations ['c4852c3d-78ca-4015-8049-3c0f936788ac', 'ba96c254-5397-41be-9085-c689a1d064b0', '3d9f09c0-6372-4f87-8958-61d473ee73b0', '9c548918-d13e-4c56-980c-d7c06904aa92'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Delete snapshot completed successfully. Jul 07 15:28:30 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-6f5d6836-165a-48da-b9e5-429c2880a9aa tempest-CinderUnicodeTest-476715153 None] Lock "cinder-73985737-13ca-41b4-a59b-beee485c1599-delete_snapshot" released by "delete_snapshot" :: held 3.453s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:31 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.info" returned: 0 in 0.679s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.644s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.197s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47838932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7073a2f0-d478-4137-ba68-8a897cc2b345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:23Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Creating volume 7073a2f0-d478-4137-ba68-8a897cc2b345 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:31 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:31 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 1073741824 Jul 07 15:28:31 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:31 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-570c4ba8-c1e0-4b63-90d6-3701a95c1e5d tempest-ProjectReaderTests-1961743153 None] Create snapshot completed successfully Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Acquiring lock "cinder-012f80fd-fe80-49c1-9b39-dbfb02e9661e-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Lock "cinder-012f80fd-fe80-49c1-9b39-dbfb02e9661e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Acquiring lock "cinder-quobyte-012f80fd-fe80-49c1-9b39-dbfb02e9661e" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-012f80fd-fe80-49c1-9b39-dbfb02e9661e" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d987d7-2d23-4a09-bdc5-4df2190e32fa]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:32 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e Jul 07 15:28:32 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-015f6e79-f830-4ca1-ae8a-d11d3f19efd8-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Lock "cinder-015f6e79-f830-4ca1-ae8a-d11d3f19efd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-015f6e79-f830-4ca1-ae8a-d11d3f19efd8" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-015f6e79-f830-4ca1-ae8a-d11d3f19efd8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Deleting offline snapshot 015f6e79-f830-4ca1-ae8a-d11d3f19efd8 of volume fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] snapshot_file for this snap is: volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61621ba-9fb2-4231-8dd9-9c05b7a9e5bd]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:32 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 1073741824" returned: 0 in 1.071s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:32 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 Jul 07 15:28:32 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:32 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 Jul 07 15:28:32 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:32 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e" returned: 0 in 0.898s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:32 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e Jul 07 15:28:32 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:33 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.796s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:33 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2098840816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6b1689-cde9-43e8-8092-289af039691f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:24Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Creating volume ba6b1689-cde9-43e8-8092-289af039691f {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:33 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26351190-aa45-45f0-bb89-27a85c48dc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7073a2f0-d478-4137-ba68-8a897cc2b345', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0df3bd8-2bba-46a2-b446-0e4975833389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8" returned: 0 in 1.002s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:28:33 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f 1073741824 Jul 07 15:28:33 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:33 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume volume-7073a2f0-d478-4137-ba68-8a897cc2b345 (7073a2f0-d478-4137-ba68-8a897cc2b345): created successfully Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0df3bd8-2bba-46a2-b446-0e4975833389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (b6cbd9d1-7a08-42f8-b489-311e9cd8a514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf10e11-8401-4670-aa31-1d3c6bdd55e7]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-23e89898-2954-469d-9987-3c98abb1451c tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created volume successfully. Jul 07 15:28:33 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-012f80fd-fe80-49c1-9b39-dbfb02e9661e" returned: 0 in 0.814s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-012f80fd-fe80-49c1-9b39-dbfb02e9661e" released by "delete_volume" :: held 1.792s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:33 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 Jul 07 15:28:33 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Created reservations ['34c930d6-b77a-47e3-999a-a1196c0b39ae', 'b191f94e-938e-4ddf-b3c0-92843c70414e', '6c702d6d-aef9-49b6-831c-73501e996e7d', '872f8148-d146-4573-8a34-20a1219ba57d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:33 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:33 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Acquiring lock "cinder-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Lock "cinder-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Acquiring lock "cinder-quobyte-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca99372f-06e7-431d-a077-1de38f034024]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:34 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 Jul 07 15:28:34 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:34 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" returned: 0 in 0.992s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:34 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 Jul 07 15:28:34 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:34 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f 1073741824" returned: 0 in 1.328s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:34 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.017s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:34 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Deleted volume successfully. Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4f690147-4a22-4998-8ebd-583a578d67ec tempest-CinderUnicodeTest-476715153 None] Lock "cinder-012f80fd-fe80-49c1-9b39-dbfb02e9661e-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:34 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f Jul 07 15:28:34 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:35 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8" returned: 0 in 1.014s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:35 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8 Jul 07 15:28:35 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:35 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8" returned: 0 in 0.870s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:35 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8 Jul 07 15:28:35 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:35 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f" returned: 0 in 0.731s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.523s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580530220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072f5685-542c-4eb9-9733-2607bb184dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:24Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Creating volume 072f5685-542c-4eb9-9733-2607bb184dd2 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:35 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:35 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 1073741824 Jul 07 15:28:35 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc859b4-4ace-4bd5-a0b8-d3ca942fc170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6b1689-cde9-43e8-8092-289af039691f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a005f50c-2691-4974-8f12-b9b76c30a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:35 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume volume-ba6b1689-cde9-43e8-8092-289af039691f (ba6b1689-cde9-43e8-8092-289af039691f): created successfully Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a005f50c-2691-4974-8f12-b9b76c30a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:35 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (b0399b7b-2206-4d67-be1c-f3d5c769f94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-493f9fe5-9780-40f8-bba7-6ae7151fe9b5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created volume successfully. Jul 07 15:28:36 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Lock "cinder-quobyte-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8" released by "delete_volume" :: held 1.867s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Created reservations ['8dd540ab-c2e7-4cba-9bf5-f0944c89456f', '30cdb563-5d52-4e17-833d-1547532e0703', 'cbc62962-f5bb-488f-9547-4d25dbbe2ee9', '7403ee72-401e-4fca-b8b4-776c76e8da25'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:36 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9.015f6e79-f830-4ca1-ae8a-d11d3f19efd8" returned: 0 in 0.718s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-015f6e79-f830-4ca1-ae8a-d11d3f19efd8" released by "_delete_snapshot" :: held 3.728s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" released by "delete_snapshot" :: held 3.758s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:36 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:36 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Created reservations ['59303bde-fab0-46a5-b482-86f1480cfd50', 'e059acd4-45bb-43e4-af93-d98dd6412ad6', '9f321da6-2fce-4356-accd-283aaf2494ee', 'c57a4805-61a0-4ac0-b13d-b1386248a0be'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:36 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Delete snapshot completed successfully. Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-34da4ef9-9a36-4772-b93b-f5f8f380fdfc tempest-ProjectReaderTests-1961743153 None] Lock "cinder-015f6e79-f830-4ca1-ae8a-d11d3f19efd8-delete_snapshot" released by "delete_snapshot" :: held 4.041s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:36 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 1073741824" returned: 0 in 0.997s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:36 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 Jul 07 15:28:36 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-fd5f4dcb-323f-44f0-a17b-fac1f36834e9-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-fd5f4dcb-323f-44f0-a17b-fac1f36834e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" acquired by "delete_volume" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7ecf8b-0e54-4ef3-a2d4-e74910193f41]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:37 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.001s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Deleted volume successfully. Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-030d3bca-08ce-453e-8324-299f7a5891c3 tempest-CinderUnicodeTest-476715153 None] Lock "cinder-c370b1bc-6ed6-4936-8b9d-e91b0802bbe8-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:37 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 Jul 07 15:28:37 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:37 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2" returned: 0 in 0.832s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.895s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-923660058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2057acd6-d60d-4955-aa31-177e7e2ce528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:24Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Creating volume 2057acd6-d60d-4955-aa31-177e7e2ce528 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:37 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5d83ef-b5eb-47e2-908e-6bffb3e6fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072f5685-542c-4eb9-9733-2607bb184dd2', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daca24e6-6bf7-4cb5-a654-258558baca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:37 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 1073741824 Jul 07 15:28:37 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume volume-072f5685-542c-4eb9-9733-2607bb184dd2 (072f5685-542c-4eb9-9733-2607bb184dd2): created successfully Jul 07 15:28:37 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daca24e6-6bf7-4cb5-a654-258558baca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (f4b99116-1a8b-4428-8b28-b6dec35f3939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-25dc87e4-c2fe-438e-9359-b5b4f1216b7f tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created volume successfully. Jul 07 15:28:38 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" returned: 0 in 1.042s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:38 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9 Jul 07 15:28:38 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:38 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 1073741824" returned: 0 in 1.076s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:38 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 Jul 07 15:28:38 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:39 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" returned: 0 in 0.800s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-fd5f4dcb-323f-44f0-a17b-fac1f36834e9" released by "delete_volume" :: held 1.982s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Created reservations ['6217a5ff-93fa-4090-b0d9-3ce94d4ba1ae', 'a65ac75d-54b2-4813-b84e-11fa75be019f', 'a723b4d1-b808-4532-9ab6-67c737eeda03', 'ce3b0143-aa4e-4771-92b4-768233dc67c9'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:39 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:39 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:39 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528" returned: 0 in 0.929s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.536s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1677586945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e15c6c4-459e-4e0b-8475-0e36416372d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3b163110d343e0b5c05ab1543d423f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:25Z,use_quota=True,user_id='d5899a97560545ef9a3500e5869d6387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Creating volume 4e15c6c4-459e-4e0b-8475-0e36416372d2 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:39 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:39 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 1073741824 Jul 07 15:28:39 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067310fb-8918-4db0-967d-b9ca97e6acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2057acd6-d60d-4955-aa31-177e7e2ce528', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a8a9cf-97e8-4a92-8422-55d5a1739a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume volume-2057acd6-d60d-4955-aa31-177e7e2ce528 (2057acd6-d60d-4955-aa31-177e7e2ce528): created successfully Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a8a9cf-97e8-4a92-8422-55d5a1739a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (9ac69bff-78ea-46f4-b642-5421cb06cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9ecdf186-5167-4827-9761-070187f08cd0 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created volume successfully. Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (b06fbbb5-593d-4ce8-b1a0-9f3f25d9f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f4d8ec-37c2-4efb-ae4a-9026b6360215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f4d8ec-37c2-4efb-ae4a-9026b6360215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152158614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6e517e-c2e3-4c5f-9570-6eb773bcf19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:40Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb39a66-b666-434b-9d55-f7301aa28f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb39a66-b666-434b-9d55-f7301aa28f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bd4beb-c29f-4ab3-981c-dbc256e51eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bd4beb-c29f-4ab3-981c-dbc256e51eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6e517e-c2e3-4c5f-9570-6eb773bcf19b', 'volume_name': 'volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b7228d-8641-43ce-9b1c-1d424d3a648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b7228d-8641-43ce-9b1c-1d424d3a648d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312c4801-93f4-410c-b044-6c05c4028bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:40 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Volume ae6e517e-c2e3-4c5f-9570-6eb773bcf19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b', 'volume_size': 1} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:40 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.981s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:40 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Deleted volume successfully. Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-53ef5a68-c92b-46af-b3c9-97804bf187b4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-fd5f4dcb-323f-44f0-a17b-fac1f36834e9-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:40 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 1073741824" returned: 0 in 1.013s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:40 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 Jul 07 15:28:40 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-5ae001ae-0ade-489d-8415-3faba6df491d tempest-ProjectAdminTests-163792897 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87257) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 15:28:41 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152158614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6e517e-c2e3-4c5f-9570-6eb773bcf19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:40Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Creating volume ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:41 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ca47f1-129d-459e-9e47-cd9a28e19aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e15c6c4-459e-4e0b-8475-0e36416372d2', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633b4cef-b4cc-418c-bea5-a7587542685e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:41 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b 1073741824 Jul 07 15:28:41 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:41 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Volume volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 (4e15c6c4-459e-4e0b-8475-0e36416372d2): created successfully Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633b4cef-b4cc-418c-bea5-a7587542685e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Flow 'volume_create_manager' (da47451b-95be-4af8-b3e3-9db220ef4bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-49e55799-6f3d-4da0-a5a9-43a5c2f20e59 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created volume successfully. Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-4e15c6c4-459e-4e0b-8475-0e36416372d2-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-4e15c6c4-459e-4e0b-8475-0e36416372d2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-quobyte-4e15c6c4-459e-4e0b-8475-0e36416372d2" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-4e15c6c4-459e-4e0b-8475-0e36416372d2" acquired by "delete_volume" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b084e31-edb7-4cc2-8ffe-59549d904e5b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:42 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 Jul 07 15:28:42 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:42 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b 1073741824" returned: 0 in 1.028s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:42 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b Jul 07 15:28:42 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:43 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2" returned: 0 in 1.015s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:43 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2 Jul 07 15:28:43 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:43 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" returned: 0 in 0.884s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312c4801-93f4-410c-b044-6c05c4028bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d40dfcd-1051-4129-9713-422d387112d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:43 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Volume volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b (ae6e517e-c2e3-4c5f-9570-6eb773bcf19b): created successfully Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d40dfcd-1051-4129-9713-422d387112d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (b06fbbb5-593d-4ce8-b1a0-9f3f25d9f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3246a8c4-2729-4e36-b804-5d2afb6ebc7a tempest-ProjectReaderTests-1961743153 None] Created volume successfully. Jul 07 15:28:43 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-4e15c6c4-459e-4e0b-8475-0e36416372d2" returned: 0 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-4e15c6c4-459e-4e0b-8475-0e36416372d2" released by "delete_volume" :: held 1.866s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:43 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created reservations ['539ceb8b-9cac-4870-acf6-4c032f474bf6', '930837b4-393f-41c9-ab54-ac69dd147756', 'f5d8160b-76d3-4850-982a-ab220893c20c', '3cce91d9-735a-4857-b801-da002e720975'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:44 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:44 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-2057acd6-d60d-4955-aa31-177e7e2ce528-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Creating offline snapshot e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 of volume ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-2057acd6-d60d-4955-aa31-177e7e2ce528-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0566bd6a-10d7-4ee6-afd5-36767af24a5f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-quobyte-2057acd6-d60d-4955-aa31-177e7e2ce528" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-2057acd6-d60d-4955-aa31-177e7e2ce528" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[265713fb-c5c1-4d50-bc59-4c163785d422]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:44 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b Jul 07 15:28:44 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:44 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 Jul 07 15:28:44 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:45 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.104s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:45 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Deleted volume successfully. Jul 07 15:28:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a7897b2b-cd8b-4f6f-8eb0-34d489653ab3 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-4e15c6c4-459e-4e0b-8475-0e36416372d2-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:45 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528" returned: 0 in 0.896s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:45 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528 Jul 07 15:28:45 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:45 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" returned: 0 in 1.159s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:45 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 1G Jul 07 15:28:45 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:46 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2057acd6-d60d-4955-aa31-177e7e2ce528" returned: 0 in 0.696s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-2057acd6-d60d-4955-aa31-177e7e2ce528" released by "delete_volume" :: held 1.662s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created reservations ['f2899de0-8773-47d7-82f9-76392e00b946', '3b961f8e-3f5e-48c6-9985-59d339b67cf2', 'f9b04e62-6cc3-4ed2-952b-1c3971109d48', '0c7ca522-aa75-4d0f-b7fd-5b7cfd818a82'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:46 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:46 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:46 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 1G" returned: 0 in 0.980s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:46 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 Jul 07 15:28:46 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-072f5685-542c-4eb9-9733-2607bb184dd2-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-072f5685-542c-4eb9-9733-2607bb184dd2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-quobyte-072f5685-542c-4eb9-9733-2607bb184dd2" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-072f5685-542c-4eb9-9733-2607bb184dd2" acquired by "delete_volume" :: waited 0.032s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (a26ba4c8-abd6-4f52-ab41-7aa44c502682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f70243-724c-4785-970c-570befbd1a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a21588-531e-48d7-b528-1af786d1cd29]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f70243-724c-4785-970c-570befbd1a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1876242832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e71b96-2370-4b86-9a40-b3666efd77e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:47Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbe648f-72b2-4614-aa8b-4633b9b1960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbe648f-72b2-4614-aa8b-4633b9b1960e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8160c549-6e51-4d67-8df8-5f9972811871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8160c549-6e51-4d67-8df8-5f9972811871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e71b96-2370-4b86-9a40-b3666efd77e5', 'volume_name': 'volume-14e71b96-2370-4b86-9a40-b3666efd77e5', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e47f534-35e5-4064-9b7b-ccce21979b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e47f534-35e5-4064-9b7b-ccce21979b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251425d5-729a-4ab7-920e-6e3af596f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Volume 14e71b96-2370-4b86-9a40-b3666efd77e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e71b96-2370-4b86-9a40-b3666efd77e5', 'volume_size': 1} Jul 07 15:28:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:47 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 Jul 07 15:28:47 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:47 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.985s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:47 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Deleted volume successfully. Jul 07 15:28:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ecab67cf-44ae-463a-9a5b-03a5d2259c68 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-2057acd6-d60d-4955-aa31-177e7e2ce528-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:47 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" returned: 0 in 0.847s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:47 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 is being set with open permissions: ugo+rw Jul 07 15:28:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:47 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 Jul 07 15:28:47 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:47 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2" returned: 0 in 0.899s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:47 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2 Jul 07 15:28:47 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:48 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" returned: 0 in 0.683s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:48 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.info Jul 07 15:28:48 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:48 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-072f5685-542c-4eb9-9733-2607bb184dd2" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-072f5685-542c-4eb9-9733-2607bb184dd2" released by "delete_volume" :: held 1.671s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created reservations ['aea5d663-f36a-4eef-9551-b8195be5ff5e', '404df6fc-914b-4917-a6b3-91e32c37699b', 'f191895e-f695-441c-9773-99273f1738cc', '43994e24-7119-4bff-8c71-267a4f5882ff'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:48 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:48 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:48 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.info" returned: 0 in 0.717s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:48 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.info is being set with open permissions: ugo+rw Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:48 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.info Jul 07 15:28:48 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-ba6b1689-cde9-43e8-8092-289af039691f-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-ba6b1689-cde9-43e8-8092-289af039691f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-quobyte-ba6b1689-cde9-43e8-8092-289af039691f" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-ba6b1689-cde9-43e8-8092-289af039691f" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbaa438-1dae-47aa-8153-5663b910a494]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:49 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f Jul 07 15:28:49 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:49 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.810s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Deleted volume successfully. Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7dd4cf09-97a6-442f-bd88-78bb7c4bd3bf tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-072f5685-542c-4eb9-9733-2607bb184dd2-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:49 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.info" returned: 0 in 0.772s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.303s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.680s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1876242832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e71b96-2370-4b86-9a40-b3666efd77e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:47Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Creating volume 14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:49 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:49 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 1073741824 Jul 07 15:28:49 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4ebf503f-cc5e-4eed-b475-c4a1306c3a80 tempest-ProjectReaderTests-1961743153 None] Create snapshot completed successfully Jul 07 15:28:50 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f" returned: 0 in 0.875s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:50 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f Jul 07 15:28:50 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:50 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 1073741824" returned: 0 in 0.902s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:50 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 Jul 07 15:28:50 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:50 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ba6b1689-cde9-43e8-8092-289af039691f" returned: 0 in 0.671s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-ba6b1689-cde9-43e8-8092-289af039691f" released by "delete_volume" :: held 1.609s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created reservations ['1c79add7-f531-4671-90ae-905a886d23db', '05997aa0-21bc-4074-b427-2f1d523ad01a', 'b0c6a5ae-773f-4334-9141-f14db4d4217f', '643c5d8b-58d2-493d-a39b-2cbeb4f688ab'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-e23eca6f-bfdc-4ddc-8f6e-6035b38400a1-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Lock "cinder-e23eca6f-bfdc-4ddc-8f6e-6035b38400a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Deleting offline snapshot e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 of volume ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:28:50 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:50 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] snapshot_file for this snap is: volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c280afe5-e3db-45f7-9a2b-4bfb10d65e37]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:51 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 Jul 07 15:28:51 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-7073a2f0-d478-4137-ba68-8a897cc2b345-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-7073a2f0-d478-4137-ba68-8a897cc2b345-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-quobyte-7073a2f0-d478-4137-ba68-8a897cc2b345" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-7073a2f0-d478-4137-ba68-8a897cc2b345" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bd766f-87af-4580-927a-15f9cc7bce5b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:51 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5" returned: 0 in 0.923s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251425d5-729a-4ab7-920e-6e3af596f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e71b96-2370-4b86-9a40-b3666efd77e5', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f2037f-d976-4e77-b6d1-50e654f90fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:51 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Volume volume-14e71b96-2370-4b86-9a40-b3666efd77e5 (14e71b96-2370-4b86-9a40-b3666efd77e5): created successfully Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f2037f-d976-4e77-b6d1-50e654f90fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (a26ba4c8-abd6-4f52-ab41-7aa44c502682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:51 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 Jul 07 15:28:51 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-fdf81e72-6b98-450b-b193-0c00b8642a5c tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:28:51 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.796s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:51 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Deleted volume successfully. Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7507355a-86ba-40cd-b829-879de18b74a5 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-ba6b1689-cde9-43e8-8092-289af039691f-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:51 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" returned: 0 in 0.970s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98fdeb3-4441-4bb9-a695-e18df574aacc]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:52 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b Jul 07 15:28:52 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Creating offline snapshot bf219056-d5ec-4ba8-9858-e465d1fc9813 of volume 14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:28:52 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc46ccf5-4fde-4b38-a90d-14728f90cc2e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:52 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345" returned: 0 in 1.123s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:52 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345 Jul 07 15:28:52 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:52 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 Jul 07 15:28:52 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:53 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" returned: 0 in 1.054s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:53 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 Jul 07 15:28:53 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:53 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-7073a2f0-d478-4137-ba68-8a897cc2b345" returned: 0 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-7073a2f0-d478-4137-ba68-8a897cc2b345" released by "delete_volume" :: held 1.969s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created reservations ['8e3e8934-7b5b-4108-ab0e-883130ffec9b', '909248e8-e944-4ee3-9408-f407f4135e09', '9ece3ceb-91b1-4382-989b-570ef63a3dd6', 'c6ef38d2-4ab6-4044-b4c0-1115b10de353'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:53 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5" returned: 0 in 1.001s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:53 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 1G Jul 07 15:28:53 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:53 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:53 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-f7a65117-61e2-4048-8a78-ca2571677890-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-f7a65117-61e2-4048-8a78-ca2571677890-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "cinder-quobyte-f7a65117-61e2-4048-8a78-ca2571677890" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-f7a65117-61e2-4048-8a78-ca2571677890" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[59121af9-00cf-4c48-8e61-ec33fc58fe4d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:53 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 Jul 07 15:28:53 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:54 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" returned: 0 in 1.047s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:54 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1 Jul 07 15:28:54 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:54 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.815s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Deleted volume successfully. Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-ff181c2e-5aa7-45e2-b066-f7b850c33138 tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-7073a2f0-d478-4137-ba68-8a897cc2b345-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:54 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 1G" returned: 0 in 1.191s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14e71b96-2370-4b86-9a40-b3666efd77e5 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:54 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14e71b96-2370-4b86-9a40-b3666efd77e5 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 Jul 07 15:28:54 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:54 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890" returned: 0 in 1.103s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:54 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890 Jul 07 15:28:54 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:55 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b.e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" returned: 0 in 0.985s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-e23eca6f-bfdc-4ddc-8f6e-6035b38400a1" released by "_delete_snapshot" :: held 4.188s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" released by "delete_snapshot" :: held 4.256s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Created reservations ['362653a4-e530-4dda-87cb-cf072f9e2caa', 'ce0d5f62-e48d-4110-92f8-e0bf48e639b4', '62a18c86-634f-45c8-b609-4d79a20c9c70', 'c802f3fc-5b31-454c-a495-84966437e71e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:55 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Delete snapshot completed successfully. Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-55339389-e093-4080-a582-9297d2f502bd tempest-ProjectReaderTests-1961743153 None] Lock "cinder-e23eca6f-bfdc-4ddc-8f6e-6035b38400a1-delete_snapshot" released by "delete_snapshot" :: held 4.441s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:55 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14e71b96-2370-4b86-9a40-b3666efd77e5 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813" returned: 0 in 0.793s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:55 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 is being set with open permissions: ugo+rw Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:55 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 Jul 07 15:28:55 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:55 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-f7a65117-61e2-4048-8a78-ca2571677890" returned: 0 in 0.779s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-quobyte-f7a65117-61e2-4048-8a78-ca2571677890" released by "delete_volume" :: held 1.936s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Created reservations ['1d0a3064-a7b8-4422-883a-2777fa0ccda4', '6a03197f-4a2e-4f4c-9e59-b36611358a2c', 'd42feefc-4c94-4ce2-a7c0-ec22f2c8ca11', 'ab961b81-8010-42c3-b886-70df19c1222c'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Flow 'volume_create_manager' (0fdc2597-f2a1-4a83-88be-4a694d090552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823f778f-ea11-4a8e-8b1f-d5aee46f7cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823f778f-ea11-4a8e-8b1f-d5aee46f7cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366176935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d788fa5a-38d7-44f0-9845-b3d26a94da2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeedffe7f0dd41f2b9da57df86b8375f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:56Z,use_quota=True,user_id='1912264c373943a1b58ab91f952d0cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:55 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:55 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d74b4fc-27e1-4b4e-bf6d-d88dd3c9984a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d74b4fc-27e1-4b4e-bf6d-d88dd3c9984a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da134380-0fc7-48ac-80ee-d419a50eeef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da134380-0fc7-48ac-80ee-d419a50eeef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd788fa5a-38d7-44f0-9845-b3d26a94da2f', 'volume_name': 'volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce78f656-4174-4879-9a5a-c3ceecf09aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce78f656-4174-4879-9a5a-c3ceecf09aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e32608-657a-43ec-b905-036bfc2c8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:55 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Volume d788fa5a-38d7-44f0-9845-b3d26a94da2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f', 'volume_size': 1} Jul 07 15:28:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11bcf16-c4fe-40fd-a0b8-99b8eefd72d6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:56 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813" returned: 0 in 0.787s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:56 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.info Jul 07 15:28:56 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:56 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b Jul 07 15:28:56 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:56 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.720s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Deleted volume successfully. Jul 07 15:28:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4de763ec-0e62-4fcf-be18-3e5497db259d tempest-CreateVolumesFromSourceVolumeTest-572103654 None] Lock "cinder-f7a65117-61e2-4048-8a78-ca2571677890-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:57 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.info" returned: 0 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:57 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.info is being set with open permissions: ugo+rw Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:57 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.info Jul 07 15:28:57 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:57 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" returned: 0 in 0.909s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:57 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b Jul 07 15:28:57 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:57 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.info" returned: 0 in 0.764s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:57 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.406s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366176935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d788fa5a-38d7-44f0-9845-b3d26a94da2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeedffe7f0dd41f2b9da57df86b8375f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:56Z,use_quota=True,user_id='1912264c373943a1b58ab91f952d0cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Creating volume d788fa5a-38d7-44f0-9845-b3d26a94da2f {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:57 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" returned: 0 in 0.760s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:57 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f 1073741824 Jul 07 15:28:57 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:57 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b" released by "delete_volume" :: held 1.741s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-553caf1e-9e75-4742-8bfc-567971edcb7f tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Created reservations ['48e38244-2f77-442c-bb8a-98c6e8661980', 'b8b3e698-0bde-4f6b-a625-445a891b178e', '880cc3d5-e7c2-4c97-9c9c-af8ab3f8c78b', 'c39dff8e-f44a-429a-abd1-2367aa20eabf'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:58 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:28:58 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-bf219056-d5ec-4ba8-9858-e465d1fc9813-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:58 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Lock "cinder-bf219056-d5ec-4ba8-9858-e465d1fc9813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-14e71b96-2370-4b86-9a40-b3666efd77e5" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.864s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:58 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:28:58 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Deleted volume successfully. Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f 1073741824" returned: 0 in 1.061s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (b1663a7a-8aec-4850-8941-ddc4be231a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4d7373-16fd-45d8-bb2e-9b6de465bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-14e71b96-2370-4b86-9a40-b3666efd77e5" acquired by "delete_snapshot" :: waited 0.082s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-bf219056-d5ec-4ba8-9858-e465d1fc9813" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4d7373-16fd-45d8-bb2e-9b6de465bc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702984651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:59Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec14237-181f-4e2c-b977-b9b45a9ce2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec14237-181f-4e2c-b977-b9b45a9ce2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb42f3c7-56d3-4ea6-ba3c-a62a8bd4f2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb42f3c7-56d3-4ea6-ba3c-a62a8bd4f2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9', 'volume_name': 'volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2802a13-e6b3-4022-b1ea-cea94f9eb222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2802a13-e6b3-4022-b1ea-cea94f9eb222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52aac79-a345-4890-8dfc-e555dd828623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:59 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Volume 74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9', 'volume_size': 1} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cc2f08b2-6839-48b2-bf2d-9a1a40956f16 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-ae6e517e-c2e3-4c5f-9570-6eb773bcf19b-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-bf219056-d5ec-4ba8-9858-e465d1fc9813" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot bf219056-d5ec-4ba8-9858-e465d1fc9813 of volume 14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391d169-432b-42c4-924a-72028150a51a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:59 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f Jul 07 15:28:59 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:59 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 Jul 07 15:28:59 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:59 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f" returned: 0 in 0.649s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702984651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdea9732baad4595a9f5339645bf3434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:28:59Z,use_quota=True,user_id='3b3a21df6ae046edaaf9c295a087c0b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Creating volume 74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:28:59 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e32608-657a-43ec-b905-036bfc2c8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:59 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 1073741824 Jul 07 15:28:59 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aeb8b8-2bbc-435e-a2db-905983cd4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:28:59 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Volume volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f (d788fa5a-38d7-44f0-9845-b3d26a94da2f): created successfully Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aeb8b8-2bbc-435e-a2db-905983cd4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:28:59 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Flow 'volume_create_manager' (0fdc2597-f2a1-4a83-88be-4a694d090552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:28:59 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-47b654b4-5776-42e9-9776-2cbbe5a0a927 tempest-ProjectReaderTests-1451198872 None] Created volume successfully. Jul 07 15:29:00 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813" returned: 0 in 0.842s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14e71b96-2370-4b86-9a40-b3666efd77e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[902efcfa-3ab7-429a-974f-c5cc2d57f9d9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:00 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:00 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:00 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 Jul 07 15:29:00 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Acquiring lock "cinder-d788fa5a-38d7-44f0-9845-b3d26a94da2f-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Lock "cinder-d788fa5a-38d7-44f0-9845-b3d26a94da2f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Acquiring lock "cinder-quobyte-d788fa5a-38d7-44f0-9845-b3d26a94da2f" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Lock "cinder-quobyte-d788fa5a-38d7-44f0-9845-b3d26a94da2f" acquired by "delete_volume" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd892bc-7307-4fda-846b-c48ab2737099]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:00 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f Jul 07 15:29:00 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:00 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 1073741824" returned: 0 in 1.017s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:00 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 Jul 07 15:29:00 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:01 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:01 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5" returned: 0 in 1.167s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.140s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:29:01 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 Jul 07 15:29:01 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:01 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f" returned: 0 in 0.942s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:01 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f Jul 07 15:29:01 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:01 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" returned: 0 in 0.813s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52aac79-a345-4890-8dfc-e555dd828623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63842d5b-c68b-4f44-92f7-3d67dde0a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:01 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Volume volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 (74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9): created successfully Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63842d5b-c68b-4f44-92f7-3d67dde0a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:01 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Flow 'volume_create_manager' (b1663a7a-8aec-4850-8941-ddc4be231a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-190cf054-ef7e-426b-8351-b06e0cb427fc tempest-ProjectReaderTests-1961743153 None] Created volume successfully. Jul 07 15:29:02 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813" returned: 0 in 0.844s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:02 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813 Jul 07 15:29:02 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Flow 'volume_create_manager' (d66b2cc1-9797-4c4a-8f21-5b24fcfec6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47863fe-1f9d-45af-867b-aa8a19761e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47863fe-1f9d-45af-867b-aa8a19761e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a83498-271c-46c8-acec-e56f7f7466e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0df563642f4159be856f4e4841daf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:02Z,use_quota=True,user_id='7842d79572d2427392c50ba3e9575c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a889c37d-d299-4b61-91df-7caa1492bbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a889c37d-d299-4b61-91df-7caa1492bbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a3c0ee-39b1-4859-824c-1926e232211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.image.glance [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Creating Keystone auth plugin from conf {{(pid=87257) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:02 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Creating offline snapshot d959f4d3-9817-4a5c-bd55-1522366290d8 of volume 74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-d788fa5a-38d7-44f0-9845-b3d26a94da2f" returned: 0 in 0.851s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4342a572-22b2-4d15-ac44-88aeedab0789]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Lock "cinder-quobyte-d788fa5a-38d7-44f0-9845-b3d26a94da2f" released by "delete_volume" :: held 1.852s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a3c0ee-39b1-4859-824c-1926e232211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25a83498-271c-46c8-acec-e56f7f7466e7', 'volume_name': 'volume-25a83498-271c-46c8-acec-e56f7f7466e7', 'volume_size': 1, 'image_id': '29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1aa81513a04c121bd7c540ffff60aac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e0df563642f4159be856f4e4841daf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2b1c829100d012557c41484816251d699d453c28052982633af207f3a8702fe73a8842bef1b02cd07eb1997c57f944f4e82c233e6e4e9cf7b43f92a35042b5c', 'id': '29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'created_at': datetime.datetime(2026, 7, 7, 13, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 29, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7/file', 'properties': {}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d34722-79a1-493e-8643-bc3ceb34b3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d34722-79a1-493e-8643-bc3ceb34b3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537f31cd-f5fc-4b41-ad3e-084639aeddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:02 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Volume 25a83498-271c-46c8-acec-e56f7f7466e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25a83498-271c-46c8-acec-e56f7f7466e7', 'volume_size': 1, 'image_id': '29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1aa81513a04c121bd7c540ffff60aac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e0df563642f4159be856f4e4841daf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2b1c829100d012557c41484816251d699d453c28052982633af207f3a8702fe73a8842bef1b02cd07eb1997c57f944f4e82c233e6e4e9cf7b43f92a35042b5c', 'id': '29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'created_at': datetime.datetime(2026, 7, 7, 13, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 29, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7/file', 'properties': {}}, 'image_service': } Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Trying to clone 25a83498-271c-46c8-acec-e56f7f7466e7 from image 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'metadata': {}}]). {{(pid=87257) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Created reservations ['08765de0-72e6-48b6-9309-8cd1f6c5d614', 'cb814e1a-34e7-4bf1-aabe-98fa93753b9a', '50ce34dc-817e-465d-b3cf-e8a72714ed61', '4746b331-3c28-4829-8259-9cb113506a0f'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:02 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 Jul 07 15:29:02 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 15:29:02 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Image download 0.00 MB at 0.00 MB/s Jul 07 15:29:02 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:02 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[90774782-ec37-46d9-b303-741f3f5b9c5b]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:02 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD Jul 07 15:29:02 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:02 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5.bf219056-d5ec-4ba8-9858-e465d1fc9813" returned: 0 in 0.841s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-bf219056-d5ec-4ba8-9858-e465d1fc9813" released by "_delete_snapshot" :: held 3.862s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:02 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-14e71b96-2370-4b86-9a40-b3666efd77e5" released by "delete_snapshot" :: held 3.949s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Created reservations ['d9b76819-9ea8-41b4-bc79-fdeb6ca9aae1', 'a4cae6bd-6e7c-4250-84f0-94e199c6cb57', '7a582676-8985-410a-bdfe-d5bdf404c0ce', '76fabda0-9c72-49b5-b0ba-ad52a9edac9e'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-df3b6ee2-8cb3-4630-a09d-dd783c39fff2 tempest-ProjectMemberTests-266707773 None] Lock "cinder-bf219056-d5ec-4ba8-9858-e465d1fc9813-delete_snapshot" released by "delete_snapshot" :: held 4.347s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:03 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.826s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Flow 'volume_create_manager' (5f50aef2-ff19-469d-8805-cd7141016633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decff93c-3f40-4adb-a711-f41e9bada288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Deleted volume successfully. Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decff93c-3f40-4adb-a711-f41e9bada288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128638586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba9ada7-dfec-41f0-8337-0cac31ff6e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeedffe7f0dd41f2b9da57df86b8375f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:03Z,use_quota=True,user_id='1912264c373943a1b58ab91f952d0cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eadf948-91ae-4594-954a-efcb8ac3540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:03 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eadf948-91ae-4594-954a-efcb8ac3540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2b883b-3f74-493b-b513-83a1dfa5f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2b883b-3f74-493b-b513-83a1dfa5f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba9ada7-dfec-41f0-8337-0cac31ff6e69', 'volume_name': 'volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fe8e9c-2489-4cff-aad0-6b4167c38b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fe8e9c-2489-4cff-aad0-6b4167c38b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fee5d59-190e-4309-b95a-3529890f768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:03 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Volume 3ba9ada7-dfec-41f0-8337-0cac31ff6e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69', 'volume_size': 1} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e5af8530-945d-417b-8a0a-e51698d088a6 tempest-ProjectReaderTests-1451198872 None] Lock "cinder-d788fa5a-38d7-44f0-9845-b3d26a94da2f-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" returned: 0 in 1.114s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:03 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 1G Jul 07 15:29:03 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:03 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD" returned: 0 in 1.025s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:03 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD Jul 07 15:29:03 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-14e71b96-2370-4b86-9a40-b3666efd77e5-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Lock "cinder-14e71b96-2370-4b86-9a40-b3666efd77e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-14e71b96-2370-4b86-9a40-b3666efd77e5" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-14e71b96-2370-4b86-9a40-b3666efd77e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e8bac7-eedd-4b99-afda-d4a86e664470]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:04 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 1G" returned: 0 in 0.897s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:04 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 Jul 07 15:29:04 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:04 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Temporary image 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 is fetched for user 7842d79572d2427392c50ba3e9575c27. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 15:29:04 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 Jul 07 15:29:04 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[38979830-d043-49dd-8e18-bfc1cc9b517d]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:04 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD Jul 07 15:29:04 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:05 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8" returned: 0 in 0.712s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:05 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 is being set with open permissions: ugo+rw Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:05 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 Jul 07 15:29:05 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:05 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5" returned: 0 in 0.790s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:05 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5 Jul 07 15:29:05 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:05 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:05 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD Jul 07 15:29:05 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:05 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8" returned: 0 in 0.687s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:05 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:05 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.info Jul 07 15:29:05 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-14e71b96-2370-4b86-9a40-b3666efd77e5" returned: 0 in 0.687s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:05 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-14e71b96-2370-4b86-9a40-b3666efd77e5" released by "delete_volume" :: held 1.535s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Created reservations ['aa8634bd-9572-4773-9e90-56f6188a278d', '78a6ec85-6baa-43bd-bc02-6b2ce16527df', '2bfc77cf-f0dd-401f-a4db-0bdeb48dc2c1', 'd4e6deea-be14-4a2b-b0c8-6cc1ec96f4a0'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:06 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:06 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:06 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD" returned: 1 in 0.774s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:06 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.info" returned: 0 in 0.681s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:06 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.info is being set with open permissions: ugo+rw Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:06 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.info Jul 07 15:29:06 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:06 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:06 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:29:06 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9a19b24d-d87c-453a-aac4-43460c477279 tempest-ProjectMemberTests-266707773 None] Lock "cinder-14e71b96-2370-4b86-9a40-b3666efd77e5-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (4ab975a1-11f1-4e7b-9bc5-b8e7e10bb41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5175d0b7-7582-4d44-b684-a3c03bd1b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5175d0b7-7582-4d44-b684-a3c03bd1b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438198916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:07Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325bc1fb-e518-4982-99cd-4c0e14a9e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325bc1fb-e518-4982-99cd-4c0e14a9e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c2befb-9155-40d4-8000-f6c8c7cbd66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c2befb-9155-40d4-8000-f6c8c7cbd66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3', 'volume_name': 'volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a52460-be6a-42fd-8220-5e5f5a2a136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a52460-be6a-42fd-8220-5e5f5a2a136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518785f7-8603-473f-872f-5b7af8233fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:07 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Volume e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3', 'volume_size': 1} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:07 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.info" returned: 0 in 0.659s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.841s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.689s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128638586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba9ada7-dfec-41f0-8337-0cac31ff6e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeedffe7f0dd41f2b9da57df86b8375f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:03Z,use_quota=True,user_id='1912264c373943a1b58ab91f952d0cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Creating volume 3ba9ada7-dfec-41f0-8337-0cac31ff6e69 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:07 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:07 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 1073741824 Jul 07 15:29:07 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:07 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a8931aa7-ffe3-47e3-bb86-89441a087a38 tempest-ProjectReaderTests-1961743153 None] Create snapshot completed successfully Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-d959f4d3-9817-4a5c-bd55-1522366290d8-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-d959f4d3-9817-4a5c-bd55-1522366290d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-d959f4d3-9817-4a5c-bd55-1522366290d8" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-d959f4d3-9817-4a5c-bd55-1522366290d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Deleting offline snapshot d959f4d3-9817-4a5c-bd55-1522366290d8 of volume 74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] snapshot_file for this snap is: volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5407ec-0fcc-4d16-9a31-648a83dfcc9a]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:07 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 Jul 07 15:29:07 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:08 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 1073741824" returned: 0 in 0.834s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:08 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 Jul 07 15:29:08 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:08 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8" returned: 0 in 0.801s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57bf8b5-4a34-4cb8-ae90-6dff761b4054]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:08 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 Jul 07 15:29:08 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:08 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69" returned: 0 in 0.655s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.664s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a83498-271c-46c8-acec-e56f7f7466e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0df563642f4159be856f4e4841daf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:02Z,use_quota=True,user_id='7842d79572d2427392c50ba3e9575c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Creating volume 25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:08 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:08 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 1073741824 Jul 07 15:29:08 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fee5d59-190e-4309-b95a-3529890f768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e813d6-9665-4449-a7e1-c38607596e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:08 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Volume volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 (3ba9ada7-dfec-41f0-8337-0cac31ff6e69): created successfully Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e813d6-9665-4449-a7e1-c38607596e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:08 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Flow 'volume_create_manager' (5f50aef2-ff19-469d-8805-cd7141016633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:08 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-831ab7e7-7439-475f-90ef-095913e0be27 tempest-ProjectReaderTests-1451198872 None] Created volume successfully. Jul 07 15:29:09 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" returned: 0 in 0.770s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:09 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 Jul 07 15:29:09 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:09 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 1073741824" returned: 0 in 0.853s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:09 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 Jul 07 15:29:09 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Acquiring lock "cinder-3ba9ada7-dfec-41f0-8337-0cac31ff6e69-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Lock "cinder-3ba9ada7-dfec-41f0-8337-0cac31ff6e69-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Acquiring lock "cinder-quobyte-3ba9ada7-dfec-41f0-8337-0cac31ff6e69" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Lock "cinder-quobyte-3ba9ada7-dfec-41f0-8337-0cac31ff6e69" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[23030041-da6c-4684-8862-64b23aa82b30]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:10 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 Jul 07 15:29:10 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:10 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8" returned: 0 in 0.793s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:10 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8 Jul 07 15:29:10 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:10 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7" returned: 0 in 0.715s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.329s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438198916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:07Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Creating volume e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:10 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:10 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 1073741824 Jul 07 15:29:10 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Attempting download of 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'metadata': {}}])) to volume 25a83498-271c-46c8-acec-e56f7f7466e7. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab80b39-df20-4dbb-b27e-0671f108831e]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_hgttef1i {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:10 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_hgttef1i Jul 07 15:29:10 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:10 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69" returned: 0 in 0.844s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:10 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69 Jul 07 15:29:10 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:10 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9.d959f4d3-9817-4a5c-bd55-1522366290d8" returned: 0 in 0.770s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-d959f4d3-9817-4a5c-bd55-1522366290d8" released by "_delete_snapshot" :: held 3.234s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" released by "delete_snapshot" :: held 3.256s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Created reservations ['6be45ecd-05f4-4a86-a461-c4cd726915e9', 'd65cbd1d-054f-4752-8aa4-dfa743f90448', '538030f7-9d26-4471-b28c-307102101cdd', '34d67e0d-f82b-4674-816d-4e4ed05075ed'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:11 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Delete snapshot completed successfully. Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d4d65259-ab00-4372-95a3-04d81a488da4 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-d959f4d3-9817-4a5c-bd55-1522366290d8-delete_snapshot" released by "delete_snapshot" :: held 3.419s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:11 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_hgttef1i" returned: 0 in 0.778s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_hgttef1i {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:11 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 1073741824" returned: 0 in 0.945s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:11 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 Jul 07 15:29:11 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:11 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_hgttef1i Jul 07 15:29:11 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:11 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-3ba9ada7-dfec-41f0-8337-0cac31ff6e69" returned: 0 in 0.790s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Lock "cinder-quobyte-3ba9ada7-dfec-41f0-8337-0cac31ff6e69" released by "delete_volume" :: held 1.686s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Created reservations ['39eabe54-da7f-4742-84a5-800004724761', '7016864b-01ee-474a-80b3-0679d48dc395', '654ebbaa-f435-4334-a51f-7e30c1e9aa55', '0c317422-20f7-4dfb-b4e0-3589f58aee8b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:11 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:11 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:11 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "cinder-quobyte-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01911a-cd99-4d91-a921-2745fc456858]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:12 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" returned: 0 in 0.776s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:12 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_hgttef1i" returned: 1 in 0.850s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_hgttef1i' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cd6b8a-e4d0-499b-85df-37aacfd0501d]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518785f7-8603-473f-872f-5b7af8233fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40bf0945-8788-4a5f-8bcd-a6342c73f30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:12 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Volume volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 (e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3): created successfully Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40bf0945-8788-4a5f-8bcd-a6342c73f30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:12 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 Jul 07 15:29:12 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (4ab975a1-11f1-4e7b-9bc5-b8e7e10bb41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:12 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-89350401-c9c6-4e8c-9fcd-648665857425 tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:29:12 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD Jul 07 15:29:12 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:12 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.825s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:12 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Deleted volume successfully. Jul 07 15:29:12 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4281a09b-c176-4f16-be04-18aafa71f03c tempest-ProjectReaderTests-1451198872 None] Lock "cinder-3ba9ada7-dfec-41f0-8337-0cac31ff6e69-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:13 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" returned: 0 in 0.902s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:13 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:13 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9 Jul 07 15:29:13 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:13 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD Jul 07 15:29:13 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Creating offline snapshot 8559e4be-2803-4589-913a-7630cb6fe672 of volume e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ee07f-c237-47eb-9375-52a8cb306366]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:13 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" returned: 0 in 0.771s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-quobyte-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9" released by "delete_volume" :: held 1.783s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:13 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 Jul 07 15:29:13 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Created reservations ['2a23b02e-da1b-4e5a-8fd0-cbbab7795cfc', '6f44f11e-3aba-4f0e-a369-61456b542dd0', '39affe13-5a0b-49b0-b8a2-73004f3616d7', 'ed962b07-933e-4e9f-8d97-07191a3753ac'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:13 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD" returned: 1 in 0.894s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 was raw, converting to raw {{(pid=87257) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 15:29:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:14 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 Jul 07 15:29:14 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:14 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:14 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:14 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" returned: 0 in 1.047s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:14 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 1G Jul 07 15:29:14 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:15 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 1.018s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:15 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Deleted volume successfully. Jul 07 15:29:15 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7" returned: 0 in 1.148s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7_w6niu8fldevstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:29:15 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-afbde73c-ccfc-4790-8e68-c43b7f03bde1 tempest-ProjectReaderTests-1961743153 None] Lock "cinder-74c7ef88-aef1-48da-8a0b-9eb8a7c4a0f9-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:15 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 1G Jul 07 15:29:15 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:15 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 1G" returned: 0 in 1.012s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:15 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 Jul 07 15:29:15 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:15 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 1G" returned: 0 in 0.857s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:16 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66786e27-7c55-40a2-a08d-67f67d044295]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:16 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 Jul 07 15:29:16 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:16 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672" returned: 0 in 1.059s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:16 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 is being set with open permissions: ugo+rw Jul 07 15:29:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:16 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 Jul 07 15:29:16 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:16 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7" returned: 0 in 0.885s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:17 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 Jul 07 15:29:17 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:17 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672" returned: 0 in 0.752s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=152,cinder:UPDATE=217,cinder:DELETE=18,cinder:INSERT=53 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=228,cinder:SELECT=164,cinder:DELETE=19,cinder:INSERT=56 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:17 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.info Jul 07 15:29:17 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:17 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7" returned: 1 in 1.041s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Downloaded image 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'metadata': {}}])) to volume 25a83498-271c-46c8-acec-e56f7f7466e7 successfully. {{(pid=87257) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Temporary image 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 for user 7842d79572d2427392c50ba3e9575c27 is deleted. {{(pid=87257) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 15:29:17 devstack cinder-volume[87257]: DEBUG cinder.volume.volume_utils [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Marking volume 25a83498-271c-46c8-acec-e56f7f7466e7 as bootable. {{(pid=87257) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Copying metadata from image 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 to 25a83498-271c-46c8-acec-e56f7f7466e7. {{(pid=87257) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Creating volume glance metadata for volume 25a83498-271c-46c8-acec-e56f7f7466e7 backed by image 29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7 with: {'image_id': '29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e1aa81513a04c121bd7c540ffff60aac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87257) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537f31cd-f5fc-4b41-ad3e-084639aeddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a83498-271c-46c8-acec-e56f7f7466e7', 'volume_size': 1, 'image_id': '29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1aa81513a04c121bd7c540ffff60aac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e0df563642f4159be856f4e4841daf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f2b1c829100d012557c41484816251d699d453c28052982633af207f3a8702fe73a8842bef1b02cd07eb1997c57f944f4e82c233e6e4e9cf7b43f92a35042b5c', 'id': '29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7', 'created_at': datetime.datetime(2026, 7, 7, 13, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 13, 29, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29a0bb3c-d146-40e5-80c8-82e5a1fd1cd7/file', 'properties': {}}, 'image_service': }' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99429524-0bce-4aa0-815c-e926813f7e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:18 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Volume volume-25a83498-271c-46c8-acec-e56f7f7466e7 (25a83498-271c-46c8-acec-e56f7f7466e7): created successfully Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99429524-0bce-4aa0-815c-e926813f7e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Flow 'volume_create_manager' (d66b2cc1-9797-4c4a-8f21-5b24fcfec6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:18 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c096e9fd-a71f-4cde-995c-050463460411 tempest-VolumeImageDependencyTests-1340954221 None] Created volume successfully. Jul 07 15:29:18 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.info" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:18 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.info is being set with open permissions: ugo+rw Jul 07 15:29:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:18 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.info Jul 07 15:29:18 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:19 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.info" returned: 0 in 0.694s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.503s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:19 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1cccc065-47da-4658-9e69-1ef6e72b658e tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Acquiring lock "cinder-25a83498-271c-46c8-acec-e56f7f7466e7-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Lock "cinder-25a83498-271c-46c8-acec-e56f7f7466e7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Acquiring lock "cinder-quobyte-25a83498-271c-46c8-acec-e56f7f7466e7" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Lock "cinder-quobyte-25a83498-271c-46c8-acec-e56f7f7466e7" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0c2bc-1838-4760-a292-6cb6cc96055f]: (4, 'raw') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:19 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 Jul 07 15:29:19 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-8559e4be-2803-4589-913a-7630cb6fe672-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Lock "cinder-8559e4be-2803-4589-913a-7630cb6fe672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-8559e4be-2803-4589-913a-7630cb6fe672" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-8559e4be-2803-4589-913a-7630cb6fe672" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot 8559e4be-2803-4589-913a-7630cb6fe672 of volume e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53b70cd-92de-45a2-aafa-1c8ae7f7adc6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:20 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 Jul 07 15:29:20 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:20 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7" returned: 0 in 0.861s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:20 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 Jul 07 15:29:20 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:20 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672" returned: 0 in 0.857s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:20 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b327882-f07a-46a0-87d8-d48147482339]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:21 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 Jul 07 15:29:21 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:21 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7" returned: 1 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7' failed. Not Retrying. {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:21 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7 Jul 07 15:29:21 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:21 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" returned: 0 in 0.852s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:21 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 Jul 07 15:29:21 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:21 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-25a83498-271c-46c8-acec-e56f7f7466e7" returned: 0 in 0.706s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Lock "cinder-quobyte-25a83498-271c-46c8-acec-e56f7f7466e7" released by "delete_volume" :: held 2.460s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Created reservations ['e4d5e2c5-6831-4ae6-8154-f59126fa56ab', 'c7c97384-ebc4-47e3-9f06-a333301c7efe', '5b642fd5-09e3-4068-af51-825d907940e0', '9c73a1fc-cced-4c20-9c0b-8b9bfb395eba'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:22 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:22 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:22 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:22 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672 Jul 07 15:29:22 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:22 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.690s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:22 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Deleted volume successfully. Jul 07 15:29:22 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-cd4ebc02-8e76-4cce-837a-274982ee5e25 tempest-VolumeImageDependencyTests-1340954221 None] Lock "cinder-25a83498-271c-46c8-acec-e56f7f7466e7-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:23 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3.8559e4be-2803-4589-913a-7630cb6fe672" returned: 0 in 0.702s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-8559e4be-2803-4589-913a-7630cb6fe672" released by "_delete_snapshot" :: held 3.329s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" released by "delete_snapshot" :: held 3.352s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:23 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Created reservations ['6331777b-2b38-4df7-9f84-a10983473e60', '5434ef5d-438b-42d5-bc9f-0d943a63f3c1', '2febbeca-18e4-46c1-bc77-e5d67bc40442', '615a372b-4749-41ce-8332-6f65426ca62d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:23 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:29:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-59e38ec5-ea39-4407-b25f-aee27e1b9962 tempest-ProjectMemberTests-266707773 None] Lock "cinder-8559e4be-2803-4589-913a-7630cb6fe672-delete_snapshot" released by "delete_snapshot" :: held 3.508s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Lock "cinder-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" acquired by "delete_volume" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:24 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7575e99-4499-4db1-9efc-2a7ec2c9f51b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:24 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 Jul 07 15:29:24 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:25 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" returned: 0 in 0.848s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:25 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3 Jul 07 15:29:25 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:26 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3" released by "delete_volume" :: held 1.605s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Created reservations ['2ec03062-fdbf-4dea-a0e1-3ea3de7df6ed', 'e224470f-de47-40b2-b997-cf8a922cbfa7', 'f8dda09c-6e7a-4a70-a470-87a77c533dfa', '2b7b4f13-a976-4b8b-bb3e-26d1ebdf4d49'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:26 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:26 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:26 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.734s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:29:26 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-d55fe583-a926-413e-a403-5ecac776758e tempest-ProjectMemberTests-266707773 None] Lock "cinder-e0bdf6e8-efd9-42b2-99ea-a2b49fc761a3-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (d5808b72-409c-475e-8d3e-902a67046974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40dca38-e31a-4260-ac05-a18615156b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40dca38-e31a-4260-ac05-a18615156b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-986363617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bed459-49ab-4295-84f7-f3e9d54a1c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:27Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf84ef9e-cd48-46ad-8d7d-7cbdcb15e18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf84ef9e-cd48-46ad-8d7d-7cbdcb15e18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdf85bd-de6e-4327-ab4f-6d24f944f2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdf85bd-de6e-4327-ab4f-6d24f944f2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20bed459-49ab-4295-84f7-f3e9d54a1c19', 'volume_name': 'volume-20bed459-49ab-4295-84f7-f3e9d54a1c19', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fba465-e6b7-45fd-aaf6-1e03384787db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fba465-e6b7-45fd-aaf6-1e03384787db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463cefdc-b09a-4a15-820d-489ac23e0a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Volume 20bed459-49ab-4295-84f7-f3e9d54a1c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20bed459-49ab-4295-84f7-f3e9d54a1c19', 'volume_size': 1} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-986363617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bed459-49ab-4295-84f7-f3e9d54a1c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:27Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Creating volume 20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:27 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:27 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 1073741824 Jul 07 15:29:27 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (526bbb8f-ec60-4044-ab97-742afe050c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14233977-d13b-403b-972d-e15ec11b75d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14233977-d13b-403b-972d-e15ec11b75d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017813640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b896fc8f-a09c-4dc7-97cc-2fff378d397f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:28Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f3dad4-ed8f-4471-8277-caeb408b9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f3dad4-ed8f-4471-8277-caeb408b9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef49ac72-7483-4e98-820c-d1acac83da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef49ac72-7483-4e98-820c-d1acac83da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b896fc8f-a09c-4dc7-97cc-2fff378d397f', 'volume_name': 'volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d30e35-9efa-4a1d-a1a5-dd915a1f697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d30e35-9efa-4a1d-a1a5-dd915a1f697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5535e91a-af88-4d60-bc69-934178b1d2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:27 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Volume b896fc8f-a09c-4dc7-97cc-2fff378d397f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f', 'volume_size': 1} Jul 07 15:29:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:28 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 1073741824" returned: 0 in 0.849s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:28 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 Jul 07 15:29:28 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:28 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017813640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b896fc8f-a09c-4dc7-97cc-2fff378d397f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:28Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Creating volume b896fc8f-a09c-4dc7-97cc-2fff378d397f {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:28 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463cefdc-b09a-4a15-820d-489ac23e0a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bed459-49ab-4295-84f7-f3e9d54a1c19', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:28 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f 1073741824 Jul 07 15:29:28 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780cf6b6-7f0d-4ba6-a3e5-b1e191f94c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:28 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Volume volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 (20bed459-49ab-4295-84f7-f3e9d54a1c19): created successfully Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780cf6b6-7f0d-4ba6-a3e5-b1e191f94c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:28 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (d5808b72-409c-475e-8d3e-902a67046974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:28 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-146c0201-0a48-4e1f-9850-390ec5ce11b0 tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:29:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:29 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f 1073741824" returned: 0 in 0.890s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:29 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f Jul 07 15:29:29 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:30 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f" returned: 0 in 0.646s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.991s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5535e91a-af88-4d60-bc69-934178b1d2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332e89ff-8855-4489-9f28-7f47b67a776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Creating offline snapshot ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 of volume 20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:29:30 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Volume volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f (b896fc8f-a09c-4dc7-97cc-2fff378d397f): created successfully Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332e89ff-8855-4489-9f28-7f47b67a776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (526bbb8f-ec60-4044-ab97-742afe050c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9065a-64b1-4e6d-acf6-2fd744fa7d5e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f9b49140-1c28-448f-a6c8-74fc2af20d80 tempest-ProjectReaderTests-1874487841 None] Created volume successfully. Jul 07 15:29:30 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 Jul 07 15:29:30 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-b896fc8f-a09c-4dc7-97cc-2fff378d397f-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-b896fc8f-a09c-4dc7-97cc-2fff378d397f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-quobyte-b896fc8f-a09c-4dc7-97cc-2fff378d397f" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-b896fc8f-a09c-4dc7-97cc-2fff378d397f" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3ff995-372f-43a4-b46a-c7e5c532766b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:31 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19" returned: 0 in 0.819s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:31 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f Jul 07 15:29:31 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:31 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 1G Jul 07 15:29:31 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:32 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f" returned: 0 in 0.806s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:32 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f Jul 07 15:29:32 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:32 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 1G" returned: 0 in 0.880s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:32 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 Jul 07 15:29:32 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:32 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-b896fc8f-a09c-4dc7-97cc-2fff378d397f" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-b896fc8f-a09c-4dc7-97cc-2fff378d397f" released by "delete_volume" :: held 1.542s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Created reservations ['8e3f1a53-a2e2-41ae-b784-6722f229b35d', '6bcbbc48-46de-4411-b203-424f29bc32f3', '924b8393-471e-4131-9642-97adbd50f687', '5d556888-af42-4be7-b705-94ad14dc2cf4'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:32 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:32 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:32 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" returned: 0 in 0.763s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:32 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 is being set with open permissions: ugo+rw Jul 07 15:29:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:32 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 Jul 07 15:29:32 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:33 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.782s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:33 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:33 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Deleted volume successfully. Jul 07 15:29:33 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-39b732d3-bfc8-4ca0-95b5-cc6a7a851d07 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-b896fc8f-a09c-4dc7-97cc-2fff378d397f-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:33 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" returned: 0 in 0.793s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:33 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.info Jul 07 15:29:33 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:33 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (d10d7623-a30e-43d7-a6a4-a30e2dd32d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61534654-ae58-4614-8b9a-6ce7cfb90567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61534654-ae58-4614-8b9a-6ce7cfb90567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438204793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8544c55-70ee-4972-aa0f-acaadcf702bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:34Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d197a21c-d5cd-4b75-84c0-5d1885cee15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d197a21c-d5cd-4b75-84c0-5d1885cee15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344f46e-466e-4896-95b6-24507272b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344f46e-466e-4896-95b6-24507272b125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8544c55-70ee-4972-aa0f-acaadcf702bf', 'volume_name': 'volume-c8544c55-70ee-4972-aa0f-acaadcf702bf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78cc69b-a687-4ae0-a7df-7f7272c9ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78cc69b-a687-4ae0-a7df-7f7272c9ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b487c8-1a2e-4650-bbec-72cdcda1cda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:34 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Volume c8544c55-70ee-4972-aa0f-acaadcf702bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8544c55-70ee-4972-aa0f-acaadcf702bf', 'volume_size': 1} Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:34 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.info" returned: 0 in 0.677s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:34 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.info is being set with open permissions: ugo+rw Jul 07 15:29:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:34 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.info Jul 07 15:29:34 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:35 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.info" returned: 0 in 0.692s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.739s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438204793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8544c55-70ee-4972-aa0f-acaadcf702bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:34Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Creating volume c8544c55-70ee-4972-aa0f-acaadcf702bf {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:35 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:35 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf 1073741824 Jul 07 15:29:35 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-ecaaaf6a-7cf6-4cc1-adee-112466ff3ac8 tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-ee2801b9-0e2c-4ab5-a8d5-f0254a60f193-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-ee2801b9-0e2c-4ab5-a8d5-f0254a60f193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-20bed459-49ab-4295-84f7-f3e9d54a1c19" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-20bed459-49ab-4295-84f7-f3e9d54a1c19" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 of volume 20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba662da-0ea6-45b0-8c01-bebfbd5cebc5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:36 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 Jul 07 15:29:36 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:36 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf 1073741824" returned: 0 in 0.926s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:36 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf Jul 07 15:29:36 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:36 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" returned: 0 in 0.845s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20bed459-49ab-4295-84f7-f3e9d54a1c19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba7a1b6-8c6c-4d29-938c-19c8a50ae24c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:36 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf" returned: 0 in 0.737s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:36 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 Jul 07 15:29:36 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b487c8-1a2e-4650-bbec-72cdcda1cda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8544c55-70ee-4972-aa0f-acaadcf702bf', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b085f13d-434c-4600-ab68-cf6943462f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:36 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Volume volume-c8544c55-70ee-4972-aa0f-acaadcf702bf (c8544c55-70ee-4972-aa0f-acaadcf702bf): created successfully Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b085f13d-434c-4600-ab68-cf6943462f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:36 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (d10d7623-a30e-43d7-a6a4-a30e2dd32d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:36 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a793aa78-4f79-48e3-95ef-6973a60ef6f9 tempest-ProjectReaderTests-1874487841 None] Created volume successfully. Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-c8544c55-70ee-4972-aa0f-acaadcf702bf-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-c8544c55-70ee-4972-aa0f-acaadcf702bf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-quobyte-c8544c55-70ee-4972-aa0f-acaadcf702bf" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-c8544c55-70ee-4972-aa0f-acaadcf702bf" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[632dd375-b5bf-4d66-a841-db75949a6f70]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:37 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf Jul 07 15:29:37 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:37 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19" returned: 0 in 0.842s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:37 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 Jul 07 15:29:37 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:38 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf" returned: 0 in 0.865s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:38 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf Jul 07 15:29:38 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:38 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" returned: 0 in 0.822s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:38 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193 Jul 07 15:29:38 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:38 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-c8544c55-70ee-4972-aa0f-acaadcf702bf" returned: 0 in 0.736s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-c8544c55-70ee-4972-aa0f-acaadcf702bf" released by "delete_volume" :: held 1.658s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Created reservations ['193ce690-7d97-4401-9642-ef4a59fbc0d2', '3e61bfdf-d42e-4ba7-afde-87695531dd1a', '908d62e8-1ee2-455c-b5ad-958dbf4a0fc6', '62bb69a0-6a50-4459-87dd-b219b800f6f5'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:39 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:39 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:39 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19.ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" returned: 0 in 0.702s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ee2801b9-0e2c-4ab5-a8d5-f0254a60f193" released by "_delete_snapshot" :: held 3.331s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-20bed459-49ab-4295-84f7-f3e9d54a1c19" released by "delete_snapshot" :: held 3.361s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Created reservations ['5703d13b-17e5-49b2-958f-b0f70ce9cd21', 'f27e983e-9f1c-4fef-912f-a6cfbd58bcb3', '0b34f776-c5c8-42a3-9611-996e5ae982a4', '1984aa3a-9602-4c1a-b769-838855dd0852'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2a5c2f19-39cc-4df9-9df1-5e18c2937ea6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-ee2801b9-0e2c-4ab5-a8d5-f0254a60f193-delete_snapshot" released by "delete_snapshot" :: held 3.508s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:39 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.674s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Deleted volume successfully. Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-2cd5b773-f753-4e16-a0d2-26cd21d5c8e2 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-c8544c55-70ee-4972-aa0f-acaadcf702bf-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (0a15a63b-be48-43af-9947-4cfb4c8fbdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52c713-212c-4025-85ed-c1969cdeccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52c713-212c-4025-85ed-c1969cdeccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217160213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b81fccc-96ac-4760-8ede-0eb84c627689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:40Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e66d5e-dac2-4708-98e3-54c205b6ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e66d5e-dac2-4708-98e3-54c205b6ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc6d841-068f-4e8d-9053-451cb8ac5328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc6d841-068f-4e8d-9053-451cb8ac5328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b81fccc-96ac-4760-8ede-0eb84c627689', 'volume_name': 'volume-0b81fccc-96ac-4760-8ede-0eb84c627689', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8783b0-89d3-47e8-b970-15c654ef04d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8783b0-89d3-47e8-b970-15c654ef04d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009eebc-0cbb-4ebd-acdc-6456a2d2e805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Volume 0b81fccc-96ac-4760-8ede-0eb84c627689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b81fccc-96ac-4760-8ede-0eb84c627689', 'volume_size': 1} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217160213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b81fccc-96ac-4760-8ede-0eb84c627689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:40Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Creating volume 0b81fccc-96ac-4760-8ede-0eb84c627689 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:39 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:40 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 1073741824 Jul 07 15:29:40 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-20bed459-49ab-4295-84f7-f3e9d54a1c19-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Lock "cinder-20bed459-49ab-4295-84f7-f3e9d54a1c19-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-20bed459-49ab-4295-84f7-f3e9d54a1c19" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-20bed459-49ab-4295-84f7-f3e9d54a1c19" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c11cfee-acdd-4ee3-b917-fc2bb7ed4b24]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:40 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 Jul 07 15:29:40 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:40 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 1073741824" returned: 0 in 0.824s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:40 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 Jul 07 15:29:40 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:40 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19" returned: 0 in 0.784s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:40 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19 Jul 07 15:29:40 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:41 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0009eebc-0cbb-4ebd-acdc-6456a2d2e805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b81fccc-96ac-4760-8ede-0eb84c627689', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b131d9-8bfb-4760-9492-b673540e94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:41 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Volume volume-0b81fccc-96ac-4760-8ede-0eb84c627689 (0b81fccc-96ac-4760-8ede-0eb84c627689): created successfully Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b131d9-8bfb-4760-9492-b673540e94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (0a15a63b-be48-43af-9947-4cfb4c8fbdf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:41 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-c42d61f7-c368-4d8c-8828-f4710be0ac99 tempest-ProjectReaderTests-1874487841 None] Created volume successfully. Jul 07 15:29:41 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-20bed459-49ab-4295-84f7-f3e9d54a1c19" returned: 0 in 0.654s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-20bed459-49ab-4295-84f7-f3e9d54a1c19" released by "delete_volume" :: held 1.494s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Created reservations ['2e0a1f05-fe35-4e50-a3bd-35d11fcca066', '8d990058-810a-488a-9247-dbaf8c2edebb', '98e3a979-321d-4d27-bdd5-cdd0c7ad5f5d', '0d58a566-84ed-4645-a09d-2cffc93c361b'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:41 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:41 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-0b81fccc-96ac-4760-8ede-0eb84c627689-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-0b81fccc-96ac-4760-8ede-0eb84c627689-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-quobyte-0b81fccc-96ac-4760-8ede-0eb84c627689" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-0b81fccc-96ac-4760-8ede-0eb84c627689" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b7962-1873-49e5-880c-46d5f58cf51d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:42 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 Jul 07 15:29:42 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:42 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:42 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-286bdd90-a688-4821-b51f-fe9fb7bf3b75 tempest-ProjectMemberTests-266707773 None] Lock "cinder-20bed459-49ab-4295-84f7-f3e9d54a1c19-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (5ed535bb-bbed-4599-8794-00e388fe25e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934da5d-6f2f-4d05-8f35-bf7078b682ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934da5d-6f2f-4d05-8f35-bf7078b682ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785288388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7ac025-f941-4090-9663-e6d022ebdf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:43Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f53767-46ac-4114-9718-439072734cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f53767-46ac-4114-9718-439072734cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6b2a46-6faf-4945-af85-07dbb17f7739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6b2a46-6faf-4945-af85-07dbb17f7739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7ac025-f941-4090-9663-e6d022ebdf03', 'volume_name': 'volume-ac7ac025-f941-4090-9663-e6d022ebdf03', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2047578-cb45-43c7-8c75-6ec5d39ae0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2047578-cb45-43c7-8c75-6ec5d39ae0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bfac3b-e194-43cd-b77a-66fc6d01a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:42 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Volume ac7ac025-f941-4090-9663-e6d022ebdf03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7ac025-f941-4090-9663-e6d022ebdf03', 'volume_size': 1} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785288388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7ac025-f941-4090-9663-e6d022ebdf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:43Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Creating volume ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:42 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:42 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 1073741824 Jul 07 15:29:42 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:42 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689" returned: 0 in 0.801s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:42 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689 Jul 07 15:29:42 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:43 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-0b81fccc-96ac-4760-8ede-0eb84c627689" returned: 0 in 0.685s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-0b81fccc-96ac-4760-8ede-0eb84c627689" released by "delete_volume" :: held 1.528s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Created reservations ['cfbc1475-d799-449c-9029-ee118ef4bd0a', '92a67ff5-5f8f-4962-aa52-31c997344de1', 'b101c7d5-32f5-4036-914a-8fa91f2dc383', '31038d95-ad36-4481-bf80-69a998e3e9ba'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:43 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 1073741824" returned: 0 in 0.849s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:43 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 Jul 07 15:29:43 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:43 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:43 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:44 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03" returned: 0 in 0.655s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bfac3b-e194-43cd-b77a-66fc6d01a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7ac025-f941-4090-9663-e6d022ebdf03', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b475ce6f-19ac-4012-84a2-ec97f4940b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:44 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.666s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Volume volume-ac7ac025-f941-4090-9663-e6d022ebdf03 (ac7ac025-f941-4090-9663-e6d022ebdf03): created successfully Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b475ce6f-19ac-4012-84a2-ec97f4940b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (5ed535bb-bbed-4599-8794-00e388fe25e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Deleted volume successfully. Jul 07 15:29:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-911ee27a-07c3-469e-aa09-7b9193457e12 tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-43f4a48e-f24f-4561-ba8f-345d0468fa97 tempest-ProjectReaderTests-1874487841 None] Lock "cinder-0b81fccc-96ac-4760-8ede-0eb84c627689-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (057f788c-01bf-4686-9029-92b70ea31732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e301c-dfc4-4052-83ee-76e1de6cd5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e301c-dfc4-4052-83ee-76e1de6cd5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752852274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b3497a-cbfc-48dc-beac-93b2ea9a62f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:45Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa6fdd5-e124-45e0-ad2a-e907dcba3e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa6fdd5-e124-45e0-ad2a-e907dcba3e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182be035-0719-460a-a8f4-a4767a6788c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182be035-0719-460a-a8f4-a4767a6788c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b3497a-cbfc-48dc-beac-93b2ea9a62f7', 'volume_name': 'volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d54e4c0-6551-4245-9071-aa1b50e15640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d54e4c0-6551-4245-9071-aa1b50e15640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c756aa4d-06e1-4a83-8752-a3b0b8a68e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:44 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Volume 56b3497a-cbfc-48dc-beac-93b2ea9a62f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7', 'volume_size': 1} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752852274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b3497a-cbfc-48dc-beac-93b2ea9a62f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717f746935f54d79966a8b2c022d522e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:45Z,use_quota=True,user_id='40f5c9e2ddfd4465ae2bf298a514373d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Creating volume 56b3497a-cbfc-48dc-beac-93b2ea9a62f7 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:44 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:44 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 1073741824 Jul 07 15:29:44 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:45 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 1073741824" returned: 0 in 0.826s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:45 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 Jul 07 15:29:45 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:46 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7" returned: 0 in 0.635s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.264s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c756aa4d-06e1-4a83-8752-a3b0b8a68e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35a2e77-19b7-400c-906f-3403a8065272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Creating offline snapshot be1e5654-60b9-4cff-84be-6b60cac71908 of volume ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:29:46 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Volume volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 (56b3497a-cbfc-48dc-beac-93b2ea9a62f7): created successfully Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35a2e77-19b7-400c-906f-3403a8065272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Flow 'volume_create_manager' (057f788c-01bf-4686-9029-92b70ea31732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c510daab-15ed-4d25-969b-1d7625daec28]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:46 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e958006a-5034-437f-96ee-3c6362dd76b8 tempest-ProjectReaderTests-1874487841 None] Created volume successfully. Jul 07 15:29:46 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 Jul 07 15:29:46 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-56b3497a-cbfc-48dc-beac-93b2ea9a62f7-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Lock "cinder-56b3497a-cbfc-48dc-beac-93b2ea9a62f7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Acquiring lock "cinder-quobyte-56b3497a-cbfc-48dc-beac-93b2ea9a62f7" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-56b3497a-cbfc-48dc-beac-93b2ea9a62f7" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[85886bae-4217-4640-9aad-d159a5661110]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:46 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 Jul 07 15:29:46 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:47 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03" returned: 0 in 0.788s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:47 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 1G Jul 07 15:29:47 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:47 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7" returned: 0 in 0.777s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:47 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7 Jul 07 15:29:47 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:47 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 1G" returned: 0 in 0.817s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7ac025-f941-4090-9663-e6d022ebdf03 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:47 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7ac025-f941-4090-9663-e6d022ebdf03 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 Jul 07 15:29:47 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:48 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-56b3497a-cbfc-48dc-beac-93b2ea9a62f7" returned: 0 in 0.674s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Lock "cinder-quobyte-56b3497a-cbfc-48dc-beac-93b2ea9a62f7" released by "delete_volume" :: held 1.494s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Created reservations ['9382a564-9e41-4bd9-92d9-7a378aa6c586', '09326f49-382c-403a-8c34-b8cbf62f4a9a', 'c737efee-bd59-4bef-988b-2e706b8d2cc9', 'd6dab936-4619-404e-b219-022e4db585ba'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:48 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:48 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:48 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac7ac025-f941-4090-9663-e6d022ebdf03 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908" returned: 0 in 0.713s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:48 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 is being set with open permissions: ugo+rw Jul 07 15:29:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:48 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 Jul 07 15:29:48 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:49 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.689s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:49 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:49 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Deleted volume successfully. Jul 07 15:29:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-e778ed09-2904-4fa0-a7d2-36642ee369fa tempest-ProjectReaderTests-1874487841 None] Lock "cinder-56b3497a-cbfc-48dc-beac-93b2ea9a62f7-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:49 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908" returned: 0 in 0.657s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:49 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.info Jul 07 15:29:49 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:49 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.info" returned: 0 in 0.667s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:49 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.info is being set with open permissions: ugo+rw Jul 07 15:29:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:49 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.info Jul 07 15:29:49 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:50 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.info" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.394s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-e123094c-a22a-452f-8aa6-4751cc2f52a1 tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-be1e5654-60b9-4cff-84be-6b60cac71908-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Lock "cinder-be1e5654-60b9-4cff-84be-6b60cac71908-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-ac7ac025-f941-4090-9663-e6d022ebdf03" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac7ac025-f941-4090-9663-e6d022ebdf03" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-be1e5654-60b9-4cff-84be-6b60cac71908" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-be1e5654-60b9-4cff-84be-6b60cac71908" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot be1e5654-60b9-4cff-84be-6b60cac71908 of volume ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e80d0a2-3520-4fdf-a513-60d284b9b95b]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:51 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 Jul 07 15:29:51 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:52 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908" returned: 0 in 0.741s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac7ac025-f941-4090-9663-e6d022ebdf03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:29:52 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[40445d73-6b30-4761-b0df-924bcc311540]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:52 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 Jul 07 15:29:52 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:52 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03" returned: 0 in 0.730s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:52 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 Jul 07 15:29:52 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:53 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908" returned: 0 in 0.725s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:53 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908 Jul 07 15:29:53 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:54 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03.be1e5654-60b9-4cff-84be-6b60cac71908" returned: 0 in 0.629s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-be1e5654-60b9-4cff-84be-6b60cac71908" released by "_delete_snapshot" :: held 2.911s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac7ac025-f941-4090-9663-e6d022ebdf03" released by "delete_snapshot" :: held 2.932s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Created reservations ['bc4bec91-7d60-4b83-90b1-b5b128d398c4', 'd64b480d-af7d-4bd6-a548-870422d141b8', '774ec803-e927-4e17-be6f-c9d6a2dbeff8', 'bc4eabfb-cfc3-4818-ab0d-9cc48bbbcc83'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:54 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-1735be60-2662-46df-bcf3-e13d9be95606 tempest-ProjectMemberTests-266707773 None] Lock "cinder-be1e5654-60b9-4cff-84be-6b60cac71908-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-ac7ac025-f941-4090-9663-e6d022ebdf03-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Lock "cinder-ac7ac025-f941-4090-9663-e6d022ebdf03-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-ac7ac025-f941-4090-9663-e6d022ebdf03" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac7ac025-f941-4090-9663-e6d022ebdf03" acquired by "delete_volume" :: waited 0.013s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b2dde-6706-4a88-acf0-c2772ef5bae6]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:54 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 Jul 07 15:29:54 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:55 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03" returned: 0 in 0.739s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:55 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03 Jul 07 15:29:55 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:55 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac7ac025-f941-4090-9663-e6d022ebdf03" returned: 0 in 0.638s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:55 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac7ac025-f941-4090-9663-e6d022ebdf03" released by "delete_volume" :: held 1.432s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:55 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Created reservations ['001369b7-210f-4bcb-b23e-78f9311f53fb', 'fd1f084f-00af-4eb3-860a-5f4c1f1dcec8', 'dc9319a6-981b-4f41-9f7e-be2f94332c72', 'b4f0f35c-52f2-439e-a973-e9541a24ee8d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:56 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:29:56 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:56 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.634s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:29:56 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:29:56 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-4604f19a-bb7b-47a3-9dac-032219fbfa3e tempest-ProjectMemberTests-266707773 None] Lock "cinder-ac7ac025-f941-4090-9663-e6d022ebdf03-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (c416b76b-5a47-44fe-a6dc-8e928a369c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885c34a3-6f57-4465-b7ae-07a8fa731a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885c34a3-6f57-4465-b7ae-07a8fa731a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-984586506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da57bde8-9602-460a-bf77-6d4c12a827af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:57Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e2fda2-7474-428d-ba23-ccd1c933b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e2fda2-7474-428d-ba23-ccd1c933b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e1cdd2-43de-4ef3-8baa-6f7915090697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e1cdd2-43de-4ef3-8baa-6f7915090697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da57bde8-9602-460a-bf77-6d4c12a827af', 'volume_name': 'volume-da57bde8-9602-460a-bf77-6d4c12a827af', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11470572-e52b-4530-bec4-2f420bf52f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11470572-e52b-4530-bec4-2f420bf52f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649d337b-f398-4012-b5c2-165bbda6cae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:57 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Volume da57bde8-9602-460a-bf77-6d4c12a827af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da57bde8-9602-460a-bf77-6d4c12a827af', 'volume_size': 1} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-984586506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da57bde8-9602-460a-bf77-6d4c12a827af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:29:57Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Creating volume da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:29:57 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:57 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af 1073741824 Jul 07 15:29:57 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:57 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af 1073741824" returned: 0 in 0.786s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:57 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af Jul 07 15:29:57 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:29:58 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 07 15:29:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af" returned: 0 in 0.629s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:29:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:29:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:29:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649d337b-f398-4012-b5c2-165bbda6cae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da57bde8-9602-460a-bf77-6d4c12a827af', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dea894-2d12-4d70-9bf1-122c217765dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:29:58 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Volume volume-da57bde8-9602-460a-bf77-6d4c12a827af (da57bde8-9602-460a-bf77-6d4c12a827af): created successfully Jul 07 15:29:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dea894-2d12-4d70-9bf1-122c217765dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:29:58 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (c416b76b-5a47-44fe-a6dc-8e928a369c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:29:58 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b9b91b7b-59f9-4613-9ade-11bc088ecd64 tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:29:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:29:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:29:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Creating offline snapshot c58d8a0b-d06f-4094-8142-1d524b095f75 of volume da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:29:59 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e99e2f-3abb-41a1-87a8-65794acffc7f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:29:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:29:59 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af Jul 07 15:29:59 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:00 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af" returned: 0 in 0.730s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:00 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 1G Jul 07 15:30:00 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:00 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:30:00 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:00 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.652s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:30:00 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 1G" returned: 0 in 0.785s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da57bde8-9602-460a-bf77-6d4c12a827af -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:00 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da57bde8-9602-460a-bf77-6d4c12a827af -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 Jul 07 15:30:00 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:01 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da57bde8-9602-460a-bf77-6d4c12a827af -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75" returned: 0 in 0.669s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:01 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 is being set with open permissions: ugo+rw Jul 07 15:30:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:01 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 Jul 07 15:30:01 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:02 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75" returned: 0 in 0.624s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:02 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.info Jul 07 15:30:02 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:02 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.info" returned: 0 in 0.634s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:02 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.info is being set with open permissions: ugo+rw Jul 07 15:30:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:02 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.info Jul 07 15:30:02 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:03 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.info" returned: 0 in 0.644s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.156s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-677c0cfc-2707-40c4-90d6-81ed0236b533 tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-c58d8a0b-d06f-4094-8142-1d524b095f75-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Lock "cinder-c58d8a0b-d06f-4094-8142-1d524b095f75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-da57bde8-9602-460a-bf77-6d4c12a827af" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-da57bde8-9602-460a-bf77-6d4c12a827af" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-c58d8a0b-d06f-4094-8142-1d524b095f75" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-c58d8a0b-d06f-4094-8142-1d524b095f75" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot c58d8a0b-d06f-4094-8142-1d524b095f75 of volume da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c154cf8-2caf-4134-ba08-e4a09e8d7312]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:04 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:04 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 Jul 07 15:30:04 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:05 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75" returned: 0 in 0.758s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:05 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da57bde8-9602-460a-bf77-6d4c12a827af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:30:05 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[424c66c0-7bde-4846-aa88-d1197c44369c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:05 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:05 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af Jul 07 15:30:05 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:06 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af" returned: 0 in 0.792s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:06 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 Jul 07 15:30:06 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:06 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75" returned: 0 in 0.738s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:06 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:06 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75 Jul 07 15:30:06 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:07 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:07 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af.c58d8a0b-d06f-4094-8142-1d524b095f75" returned: 0 in 0.632s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-c58d8a0b-d06f-4094-8142-1d524b095f75" released by "_delete_snapshot" :: held 3.000s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-da57bde8-9602-460a-bf77-6d4c12a827af" released by "delete_snapshot" :: held 3.023s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:07 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Created reservations ['219adefb-da38-466f-8558-3e476869425d', '5cf44c19-0faf-422d-9597-2eb926441a53', 'dfd0d24e-8d84-4a03-bf38-8dd5486ae80b', '5341cfe0-e456-4962-bd2d-3cbfc1ca1091'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:07 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:30:07 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b719f1cf-c311-4fc8-b065-8c182a7a0a9a tempest-ProjectMemberTests-266707773 None] Lock "cinder-c58d8a0b-d06f-4094-8142-1d524b095f75-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-da57bde8-9602-460a-bf77-6d4c12a827af-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-da57bde8-9602-460a-bf77-6d4c12a827af-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-da57bde8-9602-460a-bf77-6d4c12a827af" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:08 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-da57bde8-9602-460a-bf77-6d4c12a827af" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:08 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89628fb-4c9f-47f9-bd57-05d320f3afb1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:08 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:08 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af Jul 07 15:30:08 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:09 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af" returned: 0 in 0.746s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:09 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:09 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af Jul 07 15:30:09 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:10 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-da57bde8-9602-460a-bf77-6d4c12a827af" returned: 0 in 0.628s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-da57bde8-9602-460a-bf77-6d4c12a827af" released by "delete_volume" :: held 1.430s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Created reservations ['7a717dc9-a69b-4b9a-a4d3-efd429380761', '38fa06cb-6d45-44d1-a35c-f3248c4919d2', '6867557d-9e08-48dd-a333-e94fcce98e49', '3934300c-0fb4-4071-b900-e4cfa4939465'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:10 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:30:10 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:10 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.644s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:30:10 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:30:10 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-37e8e047-2450-4ff7-8bc5-ebddcb8c91d6 tempest-ProjectMemberTests-266707773 None] Lock "cinder-da57bde8-9602-460a-bf77-6d4c12a827af-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (64f0cff0-975a-43bf-9b96-404c8e9dc363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96ebef6-4fb9-4b46-aeaa-e31ff3e046ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96ebef6-4fb9-4b46-aeaa-e31ff3e046ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2134986636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41570303-56aa-4730-b2a1-947abeb21d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:11Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a5f39e-2914-46e8-bf1f-db1da8cb4185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a5f39e-2914-46e8-bf1f-db1da8cb4185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fef11a8-5adb-422a-a5bb-cb2d99e1450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fef11a8-5adb-422a-a5bb-cb2d99e1450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41570303-56aa-4730-b2a1-947abeb21d77', 'volume_name': 'volume-41570303-56aa-4730-b2a1-947abeb21d77', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e061b8cc-6c34-4c43-95c4-ac42e2048e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e061b8cc-6c34-4c43-95c4-ac42e2048e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1acf5d-c165-4e6d-8cdc-2fef850f1aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:11 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Volume 41570303-56aa-4730-b2a1-947abeb21d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41570303-56aa-4730-b2a1-947abeb21d77', 'volume_size': 1} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2134986636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41570303-56aa-4730-b2a1-947abeb21d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:11Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Creating volume 41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:30:11 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:30:11 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:11 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 1073741824 Jul 07 15:30:11 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:12 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 1073741824" returned: 0 in 0.810s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:12 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 Jul 07 15:30:12 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:12 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77" returned: 0 in 0.635s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1acf5d-c165-4e6d-8cdc-2fef850f1aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41570303-56aa-4730-b2a1-947abeb21d77', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad0a21e-72e6-4796-bc0b-4c211aa555d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:12 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Volume volume-41570303-56aa-4730-b2a1-947abeb21d77 (41570303-56aa-4730-b2a1-947abeb21d77): created successfully Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad0a21e-72e6-4796-bc0b-4c211aa555d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:12 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (64f0cff0-975a-43bf-9b96-404c8e9dc363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:12 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-4d6abd47-b29b-4c57-9c90-52d736762010 tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:30:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:13 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Creating offline snapshot 3b84e057-44ba-4760-9eb3-d3887d2ed21a of volume 41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:30:13 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239a03a-6c58-4915-88a0-513528d7dbb5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:13 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:13 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 Jul 07 15:30:13 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:14 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77" returned: 0 in 0.759s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:14 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:14 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a 1G Jul 07 15:30:14 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:15 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a 1G" returned: 0 in 0.763s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41570303-56aa-4730-b2a1-947abeb21d77 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:15 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41570303-56aa-4730-b2a1-947abeb21d77 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a Jul 07 15:30:15 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:15 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41570303-56aa-4730-b2a1-947abeb21d77 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a" returned: 0 in 0.675s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:15 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a is being set with open permissions: ugo+rw Jul 07 15:30:15 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:15 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a Jul 07 15:30:15 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:16 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a" returned: 0 in 0.625s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:16 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:16 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.info Jul 07 15:30:16 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:17 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.info" returned: 0 in 0.641s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:17 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.info is being set with open permissions: ugo+rw Jul 07 15:30:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:17 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.info Jul 07 15:30:17 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:17 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.info" returned: 0 in 0.639s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:17 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:17 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=100,cinder:INSERT=34,cinder:UPDATE=127,cinder:DELETE=10 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:30:17 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=127,cinder:SELECT=92,cinder:INSERT=39,cinder:DELETE=12 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:30:17 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8bdd7aaa-92d1-4bdf-9fa5-dde05f866b7b tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-3b84e057-44ba-4760-9eb3-d3887d2ed21a-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Lock "cinder-3b84e057-44ba-4760-9eb3-d3887d2ed21a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-41570303-56aa-4730-b2a1-947abeb21d77" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-41570303-56aa-4730-b2a1-947abeb21d77" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-3b84e057-44ba-4760-9eb3-d3887d2ed21a" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-3b84e057-44ba-4760-9eb3-d3887d2ed21a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot 3b84e057-44ba-4760-9eb3-d3887d2ed21a of volume 41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8355c0-dbf9-44c6-b040-cd4524a416a3]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:18 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:18 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a Jul 07 15:30:18 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:19 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a" returned: 0 in 0.763s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:19 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41570303-56aa-4730-b2a1-947abeb21d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:30:19 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a3b2e0-eb2a-4cbf-a527-428a82ccc52c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:19 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:19 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 Jul 07 15:30:19 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:20 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77" returned: 0 in 0.745s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:20 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:20 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a Jul 07 15:30:20 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:21 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a" returned: 0 in 0.723s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:21 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a Jul 07 15:30:21 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:21 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77.3b84e057-44ba-4760-9eb3-d3887d2ed21a" returned: 0 in 0.624s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-3b84e057-44ba-4760-9eb3-d3887d2ed21a" released by "_delete_snapshot" :: held 2.944s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-41570303-56aa-4730-b2a1-947abeb21d77" released by "delete_snapshot" :: held 2.968s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Created reservations ['dbbe54e6-1c5d-42b2-ab02-b4b7ebe07ea2', '7971a01a-fa93-46e4-bbc9-f676014c23b0', '4dba1dfe-6a2b-475d-9b71-dd5da2d107a8', '5668f0ef-4e86-46ad-ae77-fcd871974f64'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:21 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-3bfbacfe-8d36-4930-a7dc-911ed3caa5a4 tempest-ProjectMemberTests-266707773 None] Lock "cinder-3b84e057-44ba-4760-9eb3-d3887d2ed21a-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-41570303-56aa-4730-b2a1-947abeb21d77-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Lock "cinder-41570303-56aa-4730-b2a1-947abeb21d77-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-41570303-56aa-4730-b2a1-947abeb21d77" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:21 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-41570303-56aa-4730-b2a1-947abeb21d77" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:22 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea77f76-afb0-46e0-8879-5ba1b304a4ad]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:22 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 Jul 07 15:30:22 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:22 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77" returned: 0 in 0.762s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:22 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:22 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77 Jul 07 15:30:22 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:23 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-41570303-56aa-4730-b2a1-947abeb21d77" returned: 0 in 0.653s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-41570303-56aa-4730-b2a1-947abeb21d77" released by "delete_volume" :: held 1.474s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Created reservations ['f190b5e3-b8bd-4740-ae75-ce5fb7d0ac46', '452d36e6-a1fb-49d0-80d7-1c2aa27ff45c', 'a7e7339e-0adc-41d9-99d6-71ee26f20b94', 'c9dd8818-3650-45f4-b0db-cbe2671acf91'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:23 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:30:23 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:24 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.628s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:30:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-bd981555-26b1-4676-9656-b2bce0e60323 tempest-ProjectMemberTests-266707773 None] Lock "cinder-41570303-56aa-4730-b2a1-947abeb21d77-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (332a434c-bea7-4eab-b86b-f6340148e9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc7d26a-0ccc-4b76-98fc-e4268479d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc7d26a-0ccc-4b76-98fc-e4268479d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-7921223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:24Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c116c82c-bd0b-48ab-8ef2-23934df263de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c116c82c-bd0b-48ab-8ef2-23934df263de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5add834-3b3b-496a-a166-4172657ae9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5add834-3b3b-496a-a166-4172657ae9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3', 'volume_name': 'volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d0f83f-7cd8-4cec-99f1-931048268555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d0f83f-7cd8-4cec-99f1-931048268555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265743c5-f148-4d0e-8fd2-eaeb3ba72506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Volume ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3', 'volume_size': 1} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-7921223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:24Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Creating volume ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:30:24 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:30:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:24 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 1073741824 Jul 07 15:30:24 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:25 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 1073741824" returned: 0 in 0.783s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:25 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 Jul 07 15:30:25 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:26 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" returned: 0 in 0.625s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265743c5-f148-4d0e-8fd2-eaeb3ba72506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489beb45-a6ca-4ba8-b4ba-1ab2afcbca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:26 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Volume volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 (ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3): created successfully Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489beb45-a6ca-4ba8-b4ba-1ab2afcbca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (332a434c-bea7-4eab-b86b-f6340148e9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:26 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-87561576-5e25-4419-8191-fdbef3b3eded tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Creating offline snapshot 74e0dff8-ee2c-4561-9372-ed1fad690b0c of volume ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf0e141-8c50-407f-9be6-41d19ded10de]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:26 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 Jul 07 15:30:26 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:27 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:27 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c 1G Jul 07 15:30:27 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:28 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c 1G" returned: 0 in 0.753s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:28 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c Jul 07 15:30:28 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:28 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c" returned: 0 in 0.661s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:28 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c is being set with open permissions: ugo+rw Jul 07 15:30:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:28 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c Jul 07 15:30:28 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:29 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c" returned: 0 in 0.633s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:29 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.info Jul 07 15:30:29 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:30 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.info" returned: 0 in 0.622s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:30 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.info is being set with open permissions: ugo+rw Jul 07 15:30:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:30 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.info Jul 07 15:30:30 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:30 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.info" returned: 0 in 0.634s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:30 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.120s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:30 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-be8ff30e-b87a-4e9a-8471-4ff2bba22e53 tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:30:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-74e0dff8-ee2c-4561-9372-ed1fad690b0c-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Lock "cinder-74e0dff8-ee2c-4561-9372-ed1fad690b0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-74e0dff8-ee2c-4561-9372-ed1fad690b0c" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-74e0dff8-ee2c-4561-9372-ed1fad690b0c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot 74e0dff8-ee2c-4561-9372-ed1fad690b0c of volume ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c985d8f-5995-452e-b29e-cadf9a443a00]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:32 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c Jul 07 15:30:32 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:32 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c" returned: 0 in 0.769s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3153c103-412a-46bd-8cdf-4beb563d332d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:32 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 Jul 07 15:30:32 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:33 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" returned: 0 in 0.743s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:33 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:33 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c Jul 07 15:30:33 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:34 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c" returned: 0 in 0.693s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:34 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c Jul 07 15:30:34 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:34 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:34 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3.74e0dff8-ee2c-4561-9372-ed1fad690b0c" returned: 0 in 0.638s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-74e0dff8-ee2c-4561-9372-ed1fad690b0c" released by "_delete_snapshot" :: held 2.935s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:34 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" released by "delete_snapshot" :: held 2.961s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Created reservations ['388ccd4e-c11f-4933-87f9-c8314b25beed', '80b72d49-6566-4789-aa0d-fe4710ba518f', 'd9a51c76-ae03-473c-ad1d-46dac930d276', '88b27ebe-5f31-467e-a4b4-5d5e40027283'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:35 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-7312e526-c283-4dee-9ddc-a54096d6655f tempest-ProjectMemberTests-266707773 None] Lock "cinder-74e0dff8-ee2c-4561-9372-ed1fad690b0c-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Lock "cinder-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e1d79c-8608-47ed-b16d-cb956f59a736]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:35 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 Jul 07 15:30:35 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:35 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" returned: 0 in 0.739s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:35 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:36 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3 Jul 07 15:30:36 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:36 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" returned: 0 in 0.624s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3" released by "delete_volume" :: held 1.415s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Created reservations ['19ff0888-b03f-43da-badd-0ab1269b525a', 'c35e16d0-8ae9-4fc0-9ba0-64a1b75ae6be', '72df139c-369d-40ec-a6b7-c979d77a0bad', 'e89119be-e0b6-4933-bb54-9a73cfb7c10a'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:36 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:36 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:30:36 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:37 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.622s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:30:37 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-54864948-ee07-4533-8cc2-3ef1a6034c93 tempest-ProjectMemberTests-266707773 None] Lock "cinder-ac8cd96e-7f47-4fa5-8c64-cbd678bcd5b3-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (901122b8-a606-4051-9879-e3fb8abb1733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde66bd4-b467-4dcf-b4aa-8293efe5513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde66bd4-b467-4dcf-b4aa-8293efe5513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859189570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e65fc33-1684-467d-9352-335db14f63ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:38Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d7ff8d-68c1-48af-8b61-9f1915a4f56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d7ff8d-68c1-48af-8b61-9f1915a4f56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f64002-dfd1-4643-8cbb-6e0ffd2f3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f64002-dfd1-4643-8cbb-6e0ffd2f3d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e65fc33-1684-467d-9352-335db14f63ea', 'volume_name': 'volume-9e65fc33-1684-467d-9352-335db14f63ea', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb47c7bc-04c3-4e74-b178-b40f98fd4a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb47c7bc-04c3-4e74-b178-b40f98fd4a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff5f83a-de68-4c27-ac6c-82263562fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:37 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Volume 9e65fc33-1684-467d-9352-335db14f63ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e65fc33-1684-467d-9352-335db14f63ea', 'volume_size': 1} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859189570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e65fc33-1684-467d-9352-335db14f63ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:38Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Creating volume 9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:30:37 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:30:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:37 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea 1073741824 Jul 07 15:30:37 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:38 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea 1073741824" returned: 0 in 0.800s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:38 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea Jul 07 15:30:38 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:39 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea" returned: 0 in 0.638s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff5f83a-de68-4c27-ac6c-82263562fc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e65fc33-1684-467d-9352-335db14f63ea', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a6645f-8208-4674-93bb-047189db3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:39 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Volume volume-9e65fc33-1684-467d-9352-335db14f63ea (9e65fc33-1684-467d-9352-335db14f63ea): created successfully Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a6645f-8208-4674-93bb-047189db3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (901122b8-a606-4051-9879-e3fb8abb1733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-873970c0-dfa3-4bd0-b0e6-385bad503b24 tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Creating offline snapshot aa49a4d5-427e-4894-94b0-51d58aaf7562 of volume 9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:30:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b14955-f320-4b93-9ad3-947484bba5b0]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:40 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea Jul 07 15:30:40 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:40 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea" returned: 0 in 0.752s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:40 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 1G Jul 07 15:30:40 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:41 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 1G" returned: 0 in 0.758s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e65fc33-1684-467d-9352-335db14f63ea -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:41 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e65fc33-1684-467d-9352-335db14f63ea -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 Jul 07 15:30:41 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:42 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e65fc33-1684-467d-9352-335db14f63ea -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562" returned: 0 in 0.676s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:42 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 is being set with open permissions: ugo+rw Jul 07 15:30:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:42 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 Jul 07 15:30:42 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:42 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562" returned: 0 in 0.628s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:42 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.info Jul 07 15:30:42 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:43 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.info" returned: 0 in 0.641s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:43 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.info is being set with open permissions: ugo+rw Jul 07 15:30:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:43 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.info Jul 07 15:30:43 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:44 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.info" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.179s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:44 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-2568972e-4de9-48de-9964-5c780c65b67a tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-aa49a4d5-427e-4894-94b0-51d58aaf7562-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Lock "cinder-aa49a4d5-427e-4894-94b0-51d58aaf7562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-9e65fc33-1684-467d-9352-335db14f63ea" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-9e65fc33-1684-467d-9352-335db14f63ea" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-aa49a4d5-427e-4894-94b0-51d58aaf7562" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-aa49a4d5-427e-4894-94b0-51d58aaf7562" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot aa49a4d5-427e-4894-94b0-51d58aaf7562 of volume 9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eeac57-1c05-4245-998a-a4f7817cc76f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:45 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 Jul 07 15:30:45 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:46 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562" returned: 0 in 0.742s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e65fc33-1684-467d-9352-335db14f63ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:30:46 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7a6ce0-9c8e-42bf-8ddd-bfd26282373e]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:46 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea Jul 07 15:30:46 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:46 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea" returned: 0 in 0.733s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:46 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 Jul 07 15:30:46 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:47 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562" returned: 0 in 0.727s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:47 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562 Jul 07 15:30:47 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:48 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea.aa49a4d5-427e-4894-94b0-51d58aaf7562" returned: 0 in 0.639s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-aa49a4d5-427e-4894-94b0-51d58aaf7562" released by "_delete_snapshot" :: held 2.923s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-9e65fc33-1684-467d-9352-335db14f63ea" released by "delete_snapshot" :: held 2.949s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Created reservations ['991c9dd7-cdfc-4513-bf57-a6e9c4122034', 'df6e6151-ef1e-40b3-a936-5ce04cd21265', '4f2dbd40-1121-4fd1-a009-dd0fb571f589', '13d4f1fb-f5ee-4404-bc2f-82df3b5b8917'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:48 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-5d770902-d22a-42a6-9179-7b5943c8f994 tempest-ProjectMemberTests-266707773 None] Lock "cinder-aa49a4d5-427e-4894-94b0-51d58aaf7562-delete_snapshot" released by "delete_snapshot" :: held 3.085s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-9e65fc33-1684-467d-9352-335db14f63ea-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Lock "cinder-9e65fc33-1684-467d-9352-335db14f63ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-9e65fc33-1684-467d-9352-335db14f63ea" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-9e65fc33-1684-467d-9352-335db14f63ea" acquired by "delete_volume" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd767a1-8089-4cae-8843-8eb83d819efa]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:48 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:48 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea Jul 07 15:30:48 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:49 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea" returned: 0 in 0.736s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:49 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea Jul 07 15:30:49 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:49 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-9e65fc33-1684-467d-9352-335db14f63ea" returned: 0 in 0.642s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-9e65fc33-1684-467d-9352-335db14f63ea" released by "delete_volume" :: held 1.441s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Created reservations ['e1ed876e-d5e8-4049-b941-fdae46d0f617', 'fc9a038f-8883-425b-8e0a-724d62b2ea12', 'b93fb5dd-e164-4dc3-996d-fc895b5f8d71', '775bee07-3be2-47e9-ba50-475d23ffe993'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:49 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:50 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:30:50 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:50 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:50 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.661s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:50 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:30:50 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:30:50 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-677b9c4a-d525-462d-b7bd-e1a1ddf5fb1c tempest-ProjectMemberTests-266707773 None] Lock "cinder-9e65fc33-1684-467d-9352-335db14f63ea-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (3f790b83-68d7-42a4-bec4-4efc11f0ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8af363b-f440-451a-987c-a618e8f7a684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8af363b-f440-451a-987c-a618e8f7a684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638797985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3099db-ae04-4aeb-b8af-2959396f4394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:51Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc2c596-ccd0-4f1a-a10c-3dbccef487fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc2c596-ccd0-4f1a-a10c-3dbccef487fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa1a0bf-6113-4df8-aa63-05636a2b579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa1a0bf-6113-4df8-aa63-05636a2b579d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3099db-ae04-4aeb-b8af-2959396f4394', 'volume_name': 'volume-2b3099db-ae04-4aeb-b8af-2959396f4394', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878257b2-e797-45c4-a03e-dd740d9e39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878257b2-e797-45c4-a03e-dd740d9e39bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a756d2ea-4304-4550-9d23-7ed5c9648d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:51 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Volume 2b3099db-ae04-4aeb-b8af-2959396f4394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3099db-ae04-4aeb-b8af-2959396f4394', 'volume_size': 1} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638797985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3099db-ae04-4aeb-b8af-2959396f4394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581eb0f72eda478e80af99e102ba5819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:30:51Z,use_quota=True,user_id='f1871dacfa7146929ec428569ffe5dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Creating volume 2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:30:51 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:51 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 1073741824 Jul 07 15:30:51 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:51 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 1073741824" returned: 0 in 0.806s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:51 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:51 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 Jul 07 15:30:51 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:52 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:52 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:30:52 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a756d2ea-4304-4550-9d23-7ed5c9648d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3099db-ae04-4aeb-b8af-2959396f4394', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76556ef-8e1b-484f-8c17-edee477cab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:30:52 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Volume volume-2b3099db-ae04-4aeb-b8af-2959396f4394 (2b3099db-ae04-4aeb-b8af-2959396f4394): created successfully Jul 07 15:30:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76556ef-8e1b-484f-8c17-edee477cab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:30:52 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Flow 'volume_create_manager' (3f790b83-68d7-42a4-bec4-4efc11f0ffff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:30:52 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-987398c3-e890-4d91-8889-66e7883dce81 tempest-ProjectMemberTests-266707773 None] Created volume successfully. Jul 07 15:30:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:30:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:30:53 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Creating offline snapshot cee13044-3e22-4534-b665-2f73a48eef3c of volume 2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:30:53 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d014b86-2c7b-42db-9bb0-33cc931417d1]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:53 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:53 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 Jul 07 15:30:53 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:54 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394" returned: 0 in 0.748s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:54 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c 1G Jul 07 15:30:54 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:54 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c 1G" returned: 0 in 0.786s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:54 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3099db-ae04-4aeb-b8af-2959396f4394 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:54 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3099db-ae04-4aeb-b8af-2959396f4394 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c Jul 07 15:30:54 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:55 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3099db-ae04-4aeb-b8af-2959396f4394 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c" returned: 0 in 0.677s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:55 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c is being set with open permissions: ugo+rw Jul 07 15:30:55 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:55 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c Jul 07 15:30:55 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:56 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c" returned: 0 in 0.641s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:56 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.info Jul 07 15:30:56 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:56 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.info" returned: 0 in 0.634s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:56 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.info is being set with open permissions: ugo+rw Jul 07 15:30:56 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:56 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.info Jul 07 15:30:56 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:57 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.info" returned: 0 in 0.637s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:57 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.196s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:30:57 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f6307aad-34ae-4d39-b76a-41b175dae143 tempest-ProjectMemberTests-266707773 None] Create snapshot completed successfully Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-cee13044-3e22-4534-b665-2f73a48eef3c-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Lock "cinder-cee13044-3e22-4534-b665-2f73a48eef3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-2b3099db-ae04-4aeb-b8af-2959396f4394" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-2b3099db-ae04-4aeb-b8af-2959396f4394" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-cee13044-3e22-4534-b665-2f73a48eef3c" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-cee13044-3e22-4534-b665-2f73a48eef3c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Deleting offline snapshot cee13044-3e22-4534-b665-2f73a48eef3c of volume 2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] snapshot_file for this snap is: volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af903eb5-93fb-432c-a074-39aa7b3e70d5]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:58 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:58 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c Jul 07 15:30:58 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:30:59 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 07 15:30:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c" returned: 0 in 0.734s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:30:59 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b3099db-ae04-4aeb-b8af-2959396f4394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:30:59 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f66131-bd62-4ad7-beb6-c2af5a114354]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:30:59 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:30:59 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 Jul 07 15:30:59 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:00 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394" returned: 0 in 0.746s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:00 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:31:00 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:00 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c Jul 07 15:31:00 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:00 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.649s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 15:31:00 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c" returned: 0 in 0.758s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:00 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c Jul 07 15:31:00 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:01 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394.cee13044-3e22-4534-b665-2f73a48eef3c" returned: 0 in 0.628s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-cee13044-3e22-4534-b665-2f73a48eef3c" released by "_delete_snapshot" :: held 2.954s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-2b3099db-ae04-4aeb-b8af-2959396f4394" released by "delete_snapshot" :: held 2.977s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Created reservations ['924219f8-2301-499a-b376-a86d0ee03e03', '7260ebe5-2d08-4967-8194-6b82b404f8ae', 'f1392c8c-2d4b-4e36-88a2-a51065c7545b', '23d728a2-9fea-45e4-aa1a-6a25680d6b6d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:31:01 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Delete snapshot completed successfully. Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-9cd58b87-a5b7-48d3-a645-11644464fbfd tempest-ProjectMemberTests-266707773 None] Lock "cinder-cee13044-3e22-4534-b665-2f73a48eef3c-delete_snapshot" released by "delete_snapshot" :: held 3.113s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-2b3099db-ae04-4aeb-b8af-2959396f4394-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Lock "cinder-2b3099db-ae04-4aeb-b8af-2959396f4394-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Acquiring lock "cinder-quobyte-2b3099db-ae04-4aeb-b8af-2959396f4394" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-2b3099db-ae04-4aeb-b8af-2959396f4394" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[23896b0e-3432-49b5-a582-8e27c8fddb64]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:01 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:01 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 Jul 07 15:31:01 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:02 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394" returned: 0 in 0.736s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:02 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:02 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394 Jul 07 15:31:02 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:03 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-2b3099db-ae04-4aeb-b8af-2959396f4394" returned: 0 in 0.641s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Lock "cinder-quobyte-2b3099db-ae04-4aeb-b8af-2959396f4394" released by "delete_volume" :: held 1.432s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Created reservations ['75f19805-145c-4294-af43-954ddb298b37', '17ee1eab-ccd7-499d-8692-44dc9d2822aa', '57650ef0-5a2b-4f7a-ad63-3011b0e7d62d', 'fbd98c68-6049-4863-a916-47e499b4bed7'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:03 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:31:03 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:03 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.634s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:03 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:31:03 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Deleted volume successfully. Jul 07 15:31:04 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-f0012943-61bb-4471-a052-5ccf4ef28f3b tempest-ProjectMemberTests-266707773 None] Lock "cinder-2b3099db-ae04-4aeb-b8af-2959396f4394-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:13 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:DELETE=5,cinder:SELECT=48,cinder:INSERT=22,cinder:UPDATE=70 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:31:13 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=55,cinder:INSERT=16,cinder:UPDATE=65,cinder:DELETE=6 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Flow 'volume_create_manager' (5b9bf0f1-e83b-4e59-bc93-f79aa8d07494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b783a8-6eaa-4dff-b19b-38c7424dab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b783a8-6eaa-4dff-b19b-38c7424dab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-905907153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886d4af6-4fad-48c7-9130-2d14d4b99574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8e169790af4b0281e8d7b30fe88726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:31:23Z,use_quota=True,user_id='079f0d7f91ca4b0881e167065aaa174d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e993d9-a6ac-4d9d-a515-09e80e9e240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e993d9-a6ac-4d9d-a515-09e80e9e240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82241548-aad4-422b-8e3d-d7047c5e536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82241548-aad4-422b-8e3d-d7047c5e536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886d4af6-4fad-48c7-9130-2d14d4b99574', 'volume_name': 'volume-886d4af6-4fad-48c7-9130-2d14d4b99574', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfa52ff-0b00-4c8c-beff-e9be298231ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfa52ff-0b00-4c8c-beff-e9be298231ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2b609b-4034-4467-86e6-bc811265aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:23 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Volume 886d4af6-4fad-48c7-9130-2d14d4b99574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886d4af6-4fad-48c7-9130-2d14d4b99574', 'volume_size': 1} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-905907153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886d4af6-4fad-48c7-9130-2d14d4b99574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8e169790af4b0281e8d7b30fe88726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:31:23Z,use_quota=True,user_id='079f0d7f91ca4b0881e167065aaa174d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)}" {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Creating volume 886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:31:23 devstack cinder-volume[87257]: INFO cinder.volume.drivers.remotefs [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] casted to osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf Jul 07 15:31:23 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 1073741824 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:23 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 1073741824 Jul 07 15:31:23 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:24 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 1073741824" returned: 0 in 0.794s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:24 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 Jul 07 15:31:24 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:24 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574" returned: 0 in 0.654s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'} {{(pid=87257) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2b609b-4034-4467-86e6-bc811265aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886d4af6-4fad-48c7-9130-2d14d4b99574', 'volume_size': 1}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dece620-3d81-4e23-a969-b001cb5ae03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:24 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Volume volume-886d4af6-4fad-48c7-9130-2d14d4b99574 (886d4af6-4fad-48c7-9130-2d14d4b99574): created successfully Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dece620-3d81-4e23-a969-b001cb5ae03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:24 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Flow 'volume_create_manager' (5b9bf0f1-e83b-4e59-bc93-f79aa8d07494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:31:24 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-8f73de61-c020-407e-b122-cba966b733ca tempest-SnapshotDependencyTests-1457246154 None] Created volume successfully. Jul 07 15:31:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:25 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Creating offline snapshot d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 of volume 886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 15:31:25 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b3d899-15ca-4883-8b76-91213b92975f]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:25 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:25 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 Jul 07 15:31:25 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:26 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574" returned: 0 in 0.768s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:26 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 1G {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:26 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 1G Jul 07 15:31:26 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:27 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 1G" returned: 0 in 0.775s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886d4af6-4fad-48c7-9130-2d14d4b99574 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:27 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886d4af6-4fad-48c7-9130-2d14d4b99574 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 Jul 07 15:31:27 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:27 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886d4af6-4fad-48c7-9130-2d14d4b99574 -F qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" returned: 0 in 0.681s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:27 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 is being set with open permissions: ugo+rw Jul 07 15:31:27 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:27 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 Jul 07 15:31:27 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:28 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" returned: 0 in 0.640s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:28 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:28 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.info Jul 07 15:31:28 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:29 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.info" returned: 0 in 0.635s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:29 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.info is being set with open permissions: ugo+rw Jul 07 15:31:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.info {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:29 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.info Jul 07 15:31:29 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:29 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.info" returned: 0 in 0.629s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:29 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.213s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:29 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-23ebdea7-7869-4a7e-83dc-73e3b219d7d2 tempest-SnapshotDependencyTests-1457246154 None] Create snapshot completed successfully Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.flows.manager.create_volume [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87257) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Flow 'volume_create_manager' (68d4b8cb-b19b-41e6-8f61-bd953399f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e8a4e0-1fb5-4464-ba4e-517a7a2f0509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e8a4e0-1fb5-4464-ba4e-517a7a2f0509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T13:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a643fbc-ed2e-4b93-aa81-16bb5209bb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8e169790af4b0281e8d7b30fe88726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T13:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T13:31:31Z,use_quota=True,user_id='079f0d7f91ca4b0881e167065aaa174d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04151ea3-f099-457a-8ee0-d98a37b5caec),volume_type_id=04151ea3-f099-457a-8ee0-d98a37b5caec)' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7328d49-3422-4e28-aab9-26ce20eb679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7328d49-3422-4e28-aab9-26ce20eb679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5275b58-93be-4f73-a736-193df07e9b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5275b58-93be-4f73-a736-193df07e9b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a643fbc-ed2e-4b93-aa81-16bb5209bb9d', 'volume_name': 'volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d', 'volume_size': 1, 'snapshot_id': 'd83f7a13-fecf-4d3d-bc5f-b1d50024b1c3'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b6dcef-50bd-4418-aef2-563b51c00ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b6dcef-50bd-4418-aef2-563b51c00ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31a7fae-a13f-4298-b3d3-48b5ad86d46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:31 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Volume 5a643fbc-ed2e-4b93-aa81-16bb5209bb9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d', 'volume_size': 1, 'snapshot_id': 'd83f7a13-fecf-4d3d-bc5f-b1d50024b1c3'} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-quobyte-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" by "_create_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Creating volume 5a643fbc-ed2e-4b93-aa81-16bb5209bb9d from snapshot d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Selected osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf as target Quobyte volume. {{(pid=87257) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-quobyte-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" by "_copy_volume_from_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] snapshot: d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3, volume: 5a643fbc-ed2e-4b93-aa81-16bb5209bb9d, {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d8db14-8dcd-4b22-9d36-d333796f6086]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:31 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:31 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 Jul 07 15:31:31 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:32 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" returned: 0 in 0.751s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886d4af6-4fad-48c7-9130-2d14d4b99574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] will copy from snapshot at /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Creating direct copy from snapshot {{(pid=87257) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f903e26-1ad8-4724-95bd-f94e5a1faa1d]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:32 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 Jul 07 15:31:32 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:32 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574" returned: 0 in 0.761s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG cinder.utils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Path /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d not found in is_blk_device check {{(pid=87257) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 15:31:32 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:33 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d Jul 07 15:31:33 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:37 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" returned: 0 in 4.372s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:37 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6f9a7f-53d1-41cd-9017-273044e5867c]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:37 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:37 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 Jul 07 15:31:37 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:38 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574" returned: 0 in 0.913s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG cinder.image.image_utils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Image conversion details: src /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574, size 1024.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d {{(pid=87257) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 15:31:38 devstack cinder-volume[87257]: INFO cinder.image.image_utils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Converted 1024.00 MB image at 234.15 MB/s Jul 07 15:31:38 devstack cinder-volume[87257]: WARNING cinder.volume.drivers.remotefs [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d is being set with open permissions: ugo+rw Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:38 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d Jul 07 15:31:38 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:38 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" returned: 0 in 0.638s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" released by "_copy_volume_from_snapshot" :: held 7.521s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" released by "_create_volume_from_snapshot" :: held 7.547s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.561s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31a7fae-a13f-4298-b3d3-48b5ad86d46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d', 'volume_size': 1, 'snapshot_id': 'd83f7a13-fecf-4d3d-bc5f-b1d50024b1c3'}' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f0e5c3-b329-43cd-b6e9-93860ffc80d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 15:31:38 devstack cinder-volume[87257]: INFO cinder.volume.flows.manager.create_volume [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Volume volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d (5a643fbc-ed2e-4b93-aa81-16bb5209bb9d): created successfully Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f0e5c3-b329-43cd-b6e9-93860ffc80d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87257) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 15:31:38 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Flow 'volume_create_manager' (68d4b8cb-b19b-41e6-8f61-bd953399f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87257) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 15:31:39 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-a254c80b-b893-4ed6-982b-0c77e64aa5f1 tempest-SnapshotDependencyTests-1457246154 None] Created volume successfully. Jul 07 15:31:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3-delete_snapshot" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-quobyte-886d4af6-4fad-48c7-9130-2d14d4b99574" by "delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-886d4af6-4fad-48c7-9130-2d14d4b99574" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-quobyte-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" by "_delete_snapshot" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:39 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:39 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Deleting offline snapshot d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 of volume 886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 15:31:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] snapshot_file for this snap is: volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 15:31:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9440d8-e878-4393-a5ad-d662ce92daf9]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:40 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 Jul 07 15:31:40 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:40 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" returned: 0 in 0.728s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:40 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.remotefs [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886d4af6-4fad-48c7-9130-2d14d4b99574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87257) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 15:31:40 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb1eb5-f3f2-4e69-9f34-000b9e8a0503]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:40 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:40 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 Jul 07 15:31:40 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:41 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574" returned: 0 in 0.750s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:41 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:41 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 Jul 07 15:31:41 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:42 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" returned: 0 in 0.717s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:42 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3 Jul 07 15:31:42 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:42 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:42 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574.d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" returned: 0 in 0.631s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3" released by "_delete_snapshot" :: held 2.923s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:42 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-886d4af6-4fad-48c7-9130-2d14d4b99574" released by "delete_snapshot" :: held 2.942s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:42 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Created reservations ['b584ea3b-8b92-425b-8ee4-44eebb294e2f', '25eca1d1-ff20-425f-9d74-8131785520ff', '3a8aa40b-6259-4895-83af-3c417f1e3bda', 'ce862442-c5f1-4898-af53-c97285d44510'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:31:43 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Delete snapshot completed successfully. Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b6b37713-7270-409c-af6d-fe239233f99c tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-d83f7a13-fecf-4d3d-bc5f-b1d50024b1c3-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-886d4af6-4fad-48c7-9130-2d14d4b99574-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-886d4af6-4fad-48c7-9130-2d14d4b99574-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-quobyte-886d4af6-4fad-48c7-9130-2d14d4b99574" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-886d4af6-4fad-48c7-9130-2d14d4b99574" acquired by "delete_volume" :: waited 0.014s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541ff91-3a82-4ca6-a5af-ccf686ee83a4]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:43 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 Jul 07 15:31:43 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:43 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574" returned: 0 in 0.733s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:43 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:43 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574 Jul 07 15:31:43 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:44 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-886d4af6-4fad-48c7-9130-2d14d4b99574" returned: 0 in 0.625s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-886d4af6-4fad-48c7-9130-2d14d4b99574" released by "delete_volume" :: held 1.414s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Created reservations ['e66482d2-6d06-4c0e-8301-129e7eaf9dae', 'b79d494d-c25c-427d-867c-015a8dff733b', '93303f39-2ca0-4459-b5ca-89648f98fc2d', '142ae64d-72ea-4662-a353-00fd986a5d6d'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:44 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:44 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:31:44 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d-delete_volume" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:45 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.641s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:31:45 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Deleted volume successfully. Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-b82c22c6-ffa7-4f50-9b05-0b26a6048a6a tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-886d4af6-4fad-48c7-9130-2d14d4b99574-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "cinder-quobyte-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" by "delete_volume" {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" acquired by "delete_volume" :: waited 0.016s {{(pid=87257) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG oslo.privsep.daemon [-] privsep: reply[acac7c13-a6ec-416e-b349-e0637c4e57fe]: (4, 'qcow2') {{(pid=88290) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 15:31:45 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:45 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d Jul 07 15:31:45 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:46 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" returned: 0 in 0.740s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:46 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d Jul 07 15:31:46 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:46 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495/volume-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" returned: 0 in 0.615s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-quobyte-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d" released by "delete_volume" :: held 1.395s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG cinder.quota [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Created reservations ['8f4d0300-7735-4341-835e-7ca3558cd778', 'da5b39bc-c37e-4c65-b828-50acb6606476', 'e7acdcb2-f423-4e05-a0ed-6d83d46cbd6b', '75178cc0-ea82-40dd-8812-6b4326b6a923'] {{(pid=87257) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:31:46 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:31:46 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:31:46 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:31:47 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 07 15:31:47 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.619s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:31:47 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:31:47 devstack cinder-volume[87257]: INFO cinder.volume.manager [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Deleted volume successfully. Jul 07 15:31:47 devstack cinder-volume[87257]: DEBUG cinder.coordination [None req-aef55098-5527-4490-a0dd-ed5347071563 tempest-SnapshotDependencyTests-1457246154 None] Lock "cinder-5a643fbc-ed2e-4b93-aa81-16bb5209bb9d-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87257) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 15:31:56 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:31:57 devstack cinder-volume[87257]: DEBUG dbcounter [-] [87257] Writing DB stats cinder:UPDATE=26,cinder:INSERT=8,cinder:DELETE=3,cinder:SELECT=20 {{(pid=87257) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf': None} {{(pid=87257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG cinder.volume.drivers.quobyte [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-35d7be2c-a104-4ab1-b0db-55c6bad667cf'] {{(pid=87257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.lockutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87257) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 15:32:00 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495 Jul 07 15:32:00 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 15:32:00 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG oslo_concurrency.processutils [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/debba277d14311dc14c4b7dca3402495" returned: 0 in 0.648s {{(pid=87257) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG cinder.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Notifying Schedulers of capabilities ... {{(pid=87257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG oslo_service.periodic_task [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] Running periodic task VolumeManager._thread_info {{(pid=87257) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread count: 29 {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 15:32:00 devstack cinder-volume[87257]: DEBUG cinder.volume.manager [None req-6eab40c5-a5cb-4034-adcf-53c89acfbb49 None None] thread info: [<_MainThread(MainThread, started 127955720482944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87257) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}